-- Logs begin at Sun 2022-07-24 00:10:39 UTC, end at Sun 2022-07-24 01:20:41 UTC. -- Jul 24 00:51:18.188781 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 24 00:51:18.197609 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 24 00:51:18.199624 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 24 00:51:18 2022] *** Jul 24 00:51:18.199624 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 24 00:51:18.199624 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 24 00:51:18.199624 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: nodename: dv-osbrick-master-4-iscsi Jul 24 00:51:18.199624 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: machine: x86_64 Jul 24 00:51:18.199624 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: clock source: unix Jul 24 00:51:18.199624 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: pcre jit disabled Jul 24 00:51:18.199624 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: detected number of CPU cores: 4 Jul 24 00:51:18.199624 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: current working directory: / Jul 24 00:51:18.199624 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: detected binary path: /usr/bin/uwsgi-core Jul 24 00:51:18.200236 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: your processes number limit is 47680 Jul 24 00:51:18.200236 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: your memory page size is 4096 bytes Jul 24 00:51:18.200236 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: detected max file descriptor number: 2048 Jul 24 00:51:18.200236 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: lock engine: pthread robust mutexes Jul 24 00:51:18.200236 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: thunder lock: enabled Jul 24 00:51:18.200236 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 24 00:51:18.200236 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 24 00:51:18.243404 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: Python main interpreter initialized at 0x55df04d879c0 Jul 24 00:51:18.243404 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: python threads support enabled Jul 24 00:51:18.243404 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: your server socket listen backlog is limited to 100 connections Jul 24 00:51:18.243404 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: your mercy for graceful operations on workers is 90 seconds Jul 24 00:51:18.243750 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: mapped 403077 bytes (393 KB) for 2 cores Jul 24 00:51:18.243821 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: *** Operational MODE: preforking *** Jul 24 00:51:18.244089 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: *** uWSGI is running in multiple interpreter mode *** Jul 24 00:51:18.244089 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: spawned uWSGI master process (pid: 80194) Jul 24 00:51:18.244293 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 24 00:51:18.245432 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: spawned uWSGI worker 1 (pid: 80201, cores: 1) Jul 24 00:51:18.245432 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: spawned uWSGI worker 2 (pid: 80202, cores: 1) Jul 24 00:51:18.245432 dv-osbrick-master-4-iscsi devstack@keystone.service[80194]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 24 00:51:23.594702 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:51:23.594702 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: from cryptography.utils import int_from_bytes Jul 24 00:51:23.595470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:51:23.595470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: from cryptography.utils import int_from_bytes Jul 24 00:51:23.595877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:51:23.595877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: from cryptography.utils import int_from_bytes Jul 24 00:51:23.595986 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:51:23.595986 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: from cryptography.utils import int_from_bytes Jul 24 00:51:23.643889 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 00:51:23.644075 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 00:51:23.644157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 00:51:23.644237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] command line args: [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 00:51:23.644298 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 00:51:23.644457 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] command line args: [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 00:51:23.644544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 00:51:23.644658 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ================================================================================ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 00:51:23.644741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 00:51:23.644940 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] admin_token = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.645073 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ================================================================================ {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 00:51:23.645162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] config_dir = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.645280 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] admin_token = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.645350 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.645507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] config_dir = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.645640 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] config_source = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.645719 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] debug = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.645816 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.645996 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.646197 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] config_source = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.646197 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] debug = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.646323 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.646389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.646481 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.646691 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.646774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.646847 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.646993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.647078 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.647240 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.647324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.647461 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_config_append = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.647556 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.647626 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_config_append = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.647690 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.647841 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.647920 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_dir = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.647986 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_dir = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.648057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_file = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_file = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.648289 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.648433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.648520 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.648594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.648794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.648911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.649052 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.649175 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.649319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.649404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.649480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.649563 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.649687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.649769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.649886 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.649970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.650084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.650158 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.650278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.650358 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.650471 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.650556 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.650746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.650869 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.650986 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.651084 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.651263 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.651399 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.651515 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.651662 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.652037 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.652163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.652261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] publish_errors = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.652338 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] publish_errors = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.652415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.652549 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.652627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.652743 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.652818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.652930 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.653042 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.653150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.653333 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.653465 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.653552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] standard_threads = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.653709 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] standard_threads = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.653889 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.653978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.654052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.654164 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.654249 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.654326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] use_journal = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.654409 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.654482 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] use_json = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.654558 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_journal = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.654669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] use_stderr = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.654755 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_json = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.654826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] use_syslog = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.654905 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_stderr = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.655084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_syslog = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.655211 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.655292 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.655372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:23.655553 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.655642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.655821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.655902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.656064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.656424 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.656516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.656589 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.656661 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.656730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.656804 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.656963 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.657052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.657237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.657350 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.657557 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.657650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.657817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.657907 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.658057 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.658137 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.658305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.658385 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.658544 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.658634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.658794 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.658875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.659043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.659125 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.659281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.659440 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.659674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.659784 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.659933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.660020 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.660195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.660275 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.660462 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.660548 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.660724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.660806 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.660973 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.661060 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.661233 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.661324 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.661473 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.661577 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.661706 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.661879 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.661962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.662133 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.662215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.662397 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.662482 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.662640 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.662716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.662871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.662946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.663104 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.663352 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.663435 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.663602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.663686 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.663843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.664307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.664444 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.664539 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.664680 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.664816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.664924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.665070 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.665147 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.665334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.665412 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.665586 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.665745 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.665820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.665891 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.666050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.666127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.666287 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.666375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.666518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.666600 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.666747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.666824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.666978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.667066 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.667206 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.667288 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.667442 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.667518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.667676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.667756 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.667906 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.667971 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.668141 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.668205 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.668367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.668440 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.668600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.668704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.668834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.668928 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.669080 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.669169 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.669316 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.669411 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.669540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.669622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.669773 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.669858 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.670009 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.670087 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.670245 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.670366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.670476 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.670569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.670704 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.670780 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.670951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.671039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.671179 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.671258 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.671412 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.671500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.671641 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.671728 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.671897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.671976 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.672133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.672259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.672346 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.672460 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.672584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.672664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.672820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.672945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.673088 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.673165 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.673354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.673431 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.673589 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.673679 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.673826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.673903 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.674060 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.674136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.674300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.674379 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.674535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.674614 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.674772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.674848 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.675005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.675082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.675240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.675316 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.675477 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.675555 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.675710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.675788 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.675944 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.676028 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.676180 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.676258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.676413 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.676498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.676646 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.676725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.676881 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.676957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.677126 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.677236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.677386 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.677464 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.677615 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.677691 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.677852 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.677941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.678074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.678159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.678308 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.678387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.678538 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.678622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.678764 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.678842 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.678992 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.679070 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.679221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.679299 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.679456 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.679536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.679684 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.679762 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.679922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.680002 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.680156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.680235 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.680401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.external = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.680477 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.680633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.680711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.680885 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.680964 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.681141 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.681265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.681397 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.password = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.681486 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.681626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.external = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.681713 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] auth.token = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.681854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.681939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.682090 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.682173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.682338 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.682424 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.682571 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.682657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.password = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.682797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.token = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.682875 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.683037 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.683124 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.683273 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.683351 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.683511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.683589 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.683739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.683825 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.683984 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.684062 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.684228 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.684305 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.684454 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.684539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.684689 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.684768 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.684923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.685001 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.685166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.685287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.685434 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.685512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.685668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.685753 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.685910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.685997 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.686144 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.686222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.686407 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.686486 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.686661 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.686748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.686896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.686974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.687147 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.687227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.687395 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.687480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.687634 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.687714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.687881 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.687967 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.688130 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.688216 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.688361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.688441 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.688652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.688731 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.688891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.688977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.689136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.689259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.689396 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.689474 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.689623 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.689713 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.689870 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.689949 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.690104 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.690184 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.690348 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.690434 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.690582 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.690659 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.690836 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.690915 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.691073 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.691229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.691308 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.691380 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.691545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.691653 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.691803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.691894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.692051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.692131 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.692289 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.692367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.692525 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.692604 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.692832 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.692909 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.693067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.693146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.693328 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.693410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.693578 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.693656 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.693830 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.693915 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.694066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.694145 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.694300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.694379 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.694532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.694611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.694779 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.694859 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.695105 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.695275 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.695354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.695508 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.695586 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.695752 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.695831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.695984 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.696063 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.696223 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.696303 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.696465 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.696544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.696694 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.696931 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.697011 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.697160 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.697282 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.697419 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.697497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.697659 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.697739 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.697894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.697971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.698137 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.698214 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.698369 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.698448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.698602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.698679 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.698843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.698920 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.699075 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.699155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.699314 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.699392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.699552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.699631 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.699782 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.699860 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.700019 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.700096 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.700249 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.700329 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.700487 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.700567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.700722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.700801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.700952 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.701030 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.701183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.701295 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.701444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.701521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.701690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.701768 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.701927 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.702007 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.702154 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.702232 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.702392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.702470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.702620 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.702699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.702861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.702939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.703093 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.703170 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.703331 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.703410 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.703568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.703647 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.703798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.703885 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.704038 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.704115 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.704296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.704373 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.704527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.704677 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.704758 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.704831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.704988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.705067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.705243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.705341 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.705477 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.705556 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.705706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.705783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.705941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.706028 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.706176 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.706254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.706411 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.706489 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.706639 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.706725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.706884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.706962 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.707132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.707209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.707367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.707453 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.707603 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.707684 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.707840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.707918 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.708066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.708151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.708310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.708389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.708543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.708622 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.708777 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.708863 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.709009 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.709088 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.709261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.709341 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.709507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.709597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.709821 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.709981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.710060 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.710220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.710314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.710815 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.710896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.711060 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.711139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.711289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.711375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.711523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.711601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.711778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.711861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.712005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.712092 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.712244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.712323 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.712472 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.712550 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.712706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.712792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.712944 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.713022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.713182 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.713311 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.713448 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.713539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.713681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.713759 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.713918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.713995 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.714156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] role.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.714310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.714386 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.714457 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] role.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.714619 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.714698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.714855 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.714942 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.715090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.715168 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.715325 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] role.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.715403 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.715570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.715656 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] role.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.715795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.715873 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.716043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.716121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.716287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.716391 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.716529 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.716606 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.716757 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.716834 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.717004 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.717084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.717266 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.717348 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.717513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.717590 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.717754 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.717833 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.717984 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.718143 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.718221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.718385 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.718472 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.718638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.718717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.718887 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.718965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.719134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.719294 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.719374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.719532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.719611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.719783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.719912 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.720077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.720157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.720326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.720404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.720574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.720653 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.720807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.720888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.721039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.721117 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.721315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.721396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.721565 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.721644 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.721797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.721876 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.722037 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.722115 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.722269 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.722348 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.722498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.722577 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.722740 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.722827 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.722980 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.723059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.723229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.723307 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.723466 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.723552 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.723695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.723772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.723929 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.724072 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.724149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.724230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.724399 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.724483 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.724635 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.724714 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.724880 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.724966 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.725119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.725228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.725375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.725497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.725609 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.725701 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.725849 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.725927 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.726094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.726172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.726321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.726406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.726553 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.726630 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.726790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.726876 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.727034 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.727121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.connection = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.727279 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.727373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.727506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.727585 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.727747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.727825 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.728021 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.728107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.728259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.728338 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.728497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.728585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.728733 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.728813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.728969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.729049 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.729233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.729314 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.729462 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.729541 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.729696 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.729777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.729929 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.730008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.730161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.730247 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.730397 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.730477 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.730629 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.730707 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.730857 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.730935 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.731090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.731169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.731324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.731402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.731479 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 00:51:23.731552 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.731782 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.732009 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.732247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.732481 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:23.732650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 00:51:23.762106 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.762344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.762568 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.762753 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.762989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.763223 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.770956 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.771561 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.799144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.799284 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.799433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.799574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.943902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.944378 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.992366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.992612 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.992940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:23.993180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.055994 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.056149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.056221 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.056286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.056404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.056495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.056636 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.056760 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.056831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.056929 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.057118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.057318 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.082474 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.082722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.082839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.083007 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.083093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.083230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.083312 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.083440 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.083525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.083645 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.083727 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.083843 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.083926 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.084145 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.095554 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.095908 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.108358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.108665 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.108840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.108932 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.109013 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.109089 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.109165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.109368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.109498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.109569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.109647 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.109761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.109854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.110010 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:24.127371 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.127557 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 24 00:51:24.127870 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.127998 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.128103 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 24 00:51:24.128185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 24 00:51:24.128363 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.128453 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.128569 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 24 00:51:24.128655 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.128847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.128942 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.129098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.129192 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.129410 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.129637 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.140146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.140422 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.140690 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.140817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.140946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.141058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.141257 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.141562 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.149117 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.149743 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.152384 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.152944 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.153071 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.153293 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.153406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.153605 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.153734 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.153852 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.153966 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.154119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.154257 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.154391 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.154521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.154659 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.154797 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.154928 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.155075 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.155194 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.155392 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.155655 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.155929 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.182518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.183193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.183468 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.184133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.184411 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.188713 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.188990 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.189305 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.189736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.190018 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.190299 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.196610 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.196802 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.197607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.197888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.201450 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.201741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.202030 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.202310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.202498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.202599 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.202808 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.202936 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.203091 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.203187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.203327 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.203423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.203631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.203904 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.204142 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.204489 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.222309 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.222588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.223519 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.223796 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.227177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.228439 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.230849 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.231146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.232114 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.232407 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.236166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.237542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.239782 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.241234 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.243576 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.243867 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.244150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.244452 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.244728 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.245011 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.245154 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.245350 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.245648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.245949 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.246232 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.246522 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.263928 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.264302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.264569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.264841 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.265516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.265901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.266173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.266443 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.272780 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.274466 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.274595 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.274834 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.276189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.276467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.277841 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.278124 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.278399 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.278680 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.279007 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.279620 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.279903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.280188 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.280487 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.280777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.292407 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.292687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.292964 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.293247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.293552 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.293833 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.294108 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.294234 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.294505 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.294764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.295047 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.295314 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.295610 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.295886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.313172 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.315155 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.316460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.318455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.319788 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.321385 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.321852 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.323004 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.323299 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.323427 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.323578 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.325080 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.325399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.325693 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.330994 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.333191 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.333696 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.334836 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.337315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.337606 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.337885 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.338161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.338455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.338750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.339036 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.339316 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.347484 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.347768 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.348048 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.348719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.349008 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.349319 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.355928 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.356209 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.356494 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.356761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.357033 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.357311 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:24.357440 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.357590 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.357747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.357833 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.357983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.358069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.358200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.358376 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.358472 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.358596 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.358736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.358921 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.359051 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.359177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.359303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.359433 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.359566 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.359727 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.359957 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.360223 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.360506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.360783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:24.397178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55df04d879c0 pid: 80202 (default app) Jul 24 00:51:24.398785 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55df04d879c0 pid: 80201 (default app) Jul 24 00:51:24.400556 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c981c-3d02-4462-af6d-d5c0fef908b1 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:24.400851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c981c-3d02-4462-af6d-d5c0fef908b1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:24.401126 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c981c-3d02-4462-af6d-d5c0fef908b1 None None] PATH_INFO: `/v3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:24.405347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Sun Jul 24 00:51:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:32.072834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94bb37-a87f-47c4-a638-09c1bef70b22 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:32.073799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94bb37-a87f-47c4-a638-09c1bef70b22 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:32.073799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94bb37-a87f-47c4-a638-09c1bef70b22 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:32.080943 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:32 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:32.090750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e497a-3249-4c13-8b13-3ebf941a1931 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:32.091178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e497a-3249-4c13-8b13-3ebf941a1931 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:32.091373 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e497a-3249-4c13-8b13-3ebf941a1931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:32.161100 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: INFO dbcounter [None req-dc7e497a-3249-4c13-8b13-3ebf941a1931 None None] Registered counter for database keystone Jul 24 00:51:32.185830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG oslo_db.sqlalchemy.engines [None req-dc7e497a-3249-4c13-8b13-3ebf941a1931 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80202) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:51:32.197445 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writer thread running {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:51:32.379081 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG passlib.handlers.bcrypt [None req-dc7e497a-3249-4c13-8b13-3ebf941a1931 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80202) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 24 00:51:32.379404 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG passlib.handlers.bcrypt [None req-dc7e497a-3249-4c13-8b13-3ebf941a1931 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80202) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 24 00:51:32.437500 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-dc7e497a-3249-4c13-8b13-3ebf941a1931 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:32.439122 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-dc7e497a-3249-4c13-8b13-3ebf941a1931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:32.564096 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 24 00:51:32.766767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94bb37-a87f-47c4-a638-09c1bef70b22 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:32.837084 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: INFO dbcounter [None req-1d94bb37-a87f-47c4-a638-09c1bef70b22 None None] Registered counter for database keystone Jul 24 00:51:32.858804 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG oslo_db.sqlalchemy.engines [None req-1d94bb37-a87f-47c4-a638-09c1bef70b22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:51:32.870966 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writer thread running {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:51:32.991589 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94bb37-a87f-47c4-a638-09c1bef70b22 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:32.997095 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb65cc-be98-49a4-bcf3-7a285227fb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:32.997792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb65cc-be98-49a4-bcf3-7a285227fb01 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:32.998080 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb65cc-be98-49a4-bcf3-7a285227fb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:32.998363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb65cc-be98-49a4-bcf3-7a285227fb01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:33.007642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb65cc-be98-49a4-bcf3-7a285227fb01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:33.058486 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8feb65cc-be98-49a4-bcf3-7a285227fb01 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 24 00:51:33.058760 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb65cc-be98-49a4-bcf3-7a285227fb01 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:33.069486 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Sun Jul 24 00:51:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 00:51:33.079791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e497a-3249-4c13-8b13-3ebf941a1931 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:33.095134 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e497a-3249-4c13-8b13-3ebf941a1931 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:33.103114 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d592d8a-2c72-47e1-9061-d4511dcf729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:33.104791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d592d8a-2c72-47e1-9061-d4511dcf729b admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:33.105156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d592d8a-2c72-47e1-9061-d4511dcf729b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:33.105559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d592d8a-2c72-47e1-9061-d4511dcf729b admin admin] PATH_INFO: `/v3/projects/e81f52df030c4fd3aed308eec001fc7b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:33.111873 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d592d8a-2c72-47e1-9061-d4511dcf729b admin admin] RBAC: Authorizing `identity:get_project(project_id=e81f52df030c4fd3aed308eec001fc7b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:33.162215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5d592d8a-2c72-47e1-9061-d4511dcf729b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 24 00:51:33.162551 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d592d8a-2c72-47e1-9061-d4511dcf729b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:33.167226 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Sun Jul 24 00:51:33 2022] GET /identity/v3/projects/e81f52df030c4fd3aed308eec001fc7b => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:35.170833 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f32a0-3045-4da2-bedc-0762294d3e26 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:35.171673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f32a0-3045-4da2-bedc-0762294d3e26 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:35.171769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f32a0-3045-4da2-bedc-0762294d3e26 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:35.179163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:35.187987 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712b7f6-9ced-4a64-9d1b-f5c8124d680e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:35.188689 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712b7f6-9ced-4a64-9d1b-f5c8124d680e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:35.188858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712b7f6-9ced-4a64-9d1b-f5c8124d680e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:35.210289 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9712b7f6-9ced-4a64-9d1b-f5c8124d680e None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:35.212207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9712b7f6-9ced-4a64-9d1b-f5c8124d680e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:35.221814 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 24 00:51:35.244638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f32a0-3045-4da2-bedc-0762294d3e26 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:35.264074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f32a0-3045-4da2-bedc-0762294d3e26 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:35.270684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065622c0-872e-469b-a89b-1f61635772d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:35.271340 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065622c0-872e-469b-a89b-1f61635772d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:35.271627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065622c0-872e-469b-a89b-1f61635772d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:35.271907 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065622c0-872e-469b-a89b-1f61635772d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:35.280214 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065622c0-872e-469b-a89b-1f61635772d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:35.282086 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065622c0-872e-469b-a89b-1f61635772d3 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:35.291289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Sun Jul 24 00:51:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 00:51:35.299719 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712b7f6-9ced-4a64-9d1b-f5c8124d680e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:35.310746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712b7f6-9ced-4a64-9d1b-f5c8124d680e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:35.316633 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26533074-e798-419e-a512-44128fad60dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:35.317572 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26533074-e798-419e-a512-44128fad60dd admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:35.317852 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26533074-e798-419e-a512-44128fad60dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:35.318139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26533074-e798-419e-a512-44128fad60dd admin admin] PATH_INFO: `/v3/users/dbbb04324a8649df81c9f75c69605aae` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:35.319693 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26533074-e798-419e-a512-44128fad60dd admin admin] RBAC: Authorizing `identity:get_user(user_id=dbbb04324a8649df81c9f75c69605aae)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:35.321579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26533074-e798-419e-a512-44128fad60dd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:35.323317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Sun Jul 24 00:51:35 2022] GET /identity/v3/users/dbbb04324a8649df81c9f75c69605aae => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:37.416703 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9884f-db3c-4b2d-9853-e6243d421f31 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.417308 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9884f-db3c-4b2d-9853-e6243d421f31 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.417308 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9884f-db3c-4b2d-9853-e6243d421f31 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.418662 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:37.423978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e978f3-3cc9-4a5e-a70f-53704695c631 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.424405 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e978f3-3cc9-4a5e-a70f-53704695c631 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.424507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e978f3-3cc9-4a5e-a70f-53704695c631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.442119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e4e978f3-3cc9-4a5e-a70f-53704695c631 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:37.443285 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e4e978f3-3cc9-4a5e-a70f-53704695c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:37.503289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d33f93-6a9f-448e-b299-1d700fae6734 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.503559 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d33f93-6a9f-448e-b299-1d700fae6734 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.503858 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d33f93-6a9f-448e-b299-1d700fae6734 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.505249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:37.510332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244b573-61a7-4e3e-a09f-f8d0180b6a82 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.510620 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244b573-61a7-4e3e-a09f-f8d0180b6a82 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.510894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244b573-61a7-4e3e-a09f-f8d0180b6a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.529598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:37.552552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG passlib.handlers.bcrypt [None req-c244b573-61a7-4e3e-a09f-f8d0180b6a82 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80201) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 24 00:51:37.552755 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e978f3-3cc9-4a5e-a70f-53704695c631 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:37.553003 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG passlib.handlers.bcrypt [None req-c244b573-61a7-4e3e-a09f-f8d0180b6a82 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80201) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 24 00:51:37.578683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:37.598578 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c244b573-61a7-4e3e-a09f-f8d0180b6a82 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:37.600160 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c244b573-61a7-4e3e-a09f-f8d0180b6a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:37.664632 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e978f3-3cc9-4a5e-a70f-53704695c631 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:37.697398 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fe4f0-ce73-496d-92b5-8065377d9852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:37.698139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fe4f0-ce73-496d-92b5-8065377d9852 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.698424 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fe4f0-ce73-496d-92b5-8065377d9852 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.698721 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fe4f0-ce73-496d-92b5-8065377d9852 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.700701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:37.709783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fe4f0-ce73-496d-92b5-8065377d9852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-1b8fe4f0-ce73-496d-92b5-8065377d9852 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:37.721344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:37.722406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:51:37.723232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:51:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:37.723904 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244b573-61a7-4e3e-a09f-f8d0180b6a82 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:37.728182 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fe4f0-ce73-496d-92b5-8065377d9852 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:37.807917 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:37.824231 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244b573-61a7-4e3e-a09f-f8d0180b6a82 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:37.826623 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:37.828260 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fe4f0-ce73-496d-92b5-8065377d9852 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:37.861457 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb9a32-b93e-4fcb-b266-15d5872a4bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:37.862369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb9a32-b93e-4fcb-b266-15d5872a4bba None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.862657 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb9a32-b93e-4fcb-b266-15d5872a4bba None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.862846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c56c5-03c9-497b-83ec-4dd4cd965e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:37.862957 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb9a32-b93e-4fcb-b266-15d5872a4bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.863530 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c56c5-03c9-497b-83ec-4dd4cd965e6a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.863816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c56c5-03c9-497b-83ec-4dd4cd965e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.864097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c56c5-03c9-497b-83ec-4dd4cd965e6a None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.864857 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c56c5-03c9-497b-83ec-4dd4cd965e6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:37.865166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c56c5-03c9-497b-83ec-4dd4cd965e6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:37.866629 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c56c5-03c9-497b-83ec-4dd4cd965e6a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:37.878603 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:37.884239 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c56c5-03c9-497b-83ec-4dd4cd965e6a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:37.929317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb9a32-b93e-4fcb-b266-15d5872a4bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:37.931097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb9a32-b93e-4fcb-b266-15d5872a4bba None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:37.982366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c56c5-03c9-497b-83ec-4dd4cd965e6a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.016387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e50fa9-4ce8-405b-8a2e-bf0db98ab517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.017322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e50fa9-4ce8-405b-8a2e-bf0db98ab517 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.017610 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e50fa9-4ce8-405b-8a2e-bf0db98ab517 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.017886 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e50fa9-4ce8-405b-8a2e-bf0db98ab517 None admin] PATH_INFO: `/v3/users/dbbb04324a8649df81c9f75c69605aae` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.019122 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e50fa9-4ce8-405b-8a2e-bf0db98ab517 None admin] RBAC: Authorizing `identity:get_user(user_id=dbbb04324a8649df81c9f75c69605aae)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:38.020588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e50fa9-4ce8-405b-8a2e-bf0db98ab517 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:38.022358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 9/16] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:37 2022] GET /identity/v3/users/dbbb04324a8649df81c9f75c69605aae => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:38.027687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e50fa9-4ce8-405b-8a2e-bf0db98ab517 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:38.030595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 8/17] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:51:38.036610 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb9a32-b93e-4fcb-b266-15d5872a4bba None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:38.039645 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:38.041878 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:38.127427 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e50fa9-4ce8-405b-8a2e-bf0db98ab517 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.135467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb9a32-b93e-4fcb-b266-15d5872a4bba None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.160032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b9c55-f033-4d1f-ba8b-7c847b97c2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.160832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b9c55-f033-4d1f-ba8b-7c847b97c2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.161113 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b9c55-f033-4d1f-ba8b-7c847b97c2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.161409 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b9c55-f033-4d1f-ba8b-7c847b97c2a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.162579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b9c55-f033-4d1f-ba8b-7c847b97c2a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:38.164143 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b9c55-f033-4d1f-ba8b-7c847b97c2a5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:38.165784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:38.169028 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabe70e-29b3-42a1-bc2c-d4d1697f5c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.169923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabe70e-29b3-42a1-bc2c-d4d1697f5c51 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.170210 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabe70e-29b3-42a1-bc2c-d4d1697f5c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.170572 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabe70e-29b3-42a1-bc2c-d4d1697f5c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.171457 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b9c55-f033-4d1f-ba8b-7c847b97c2a5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:38.190671 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabe70e-29b3-42a1-bc2c-d4d1697f5c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:38.192156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabe70e-29b3-42a1-bc2c-d4d1697f5c51 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-baabe70e-29b3-42a1-bc2c-d4d1697f5c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:51:38.212840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:38.213905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:38.214856 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:51:38.214856 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:51:38.214856 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:51:38.214856 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:51:38.214856 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:51:38.219983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabe70e-29b3-42a1-bc2c-d4d1697f5c51 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:38.256077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:38.280739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b9c55-f033-4d1f-ba8b-7c847b97c2a5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.281588 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:38.318558 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d308e-350b-45b1-a97b-d27f20973fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.319330 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d308e-350b-45b1-a97b-d27f20973fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.319619 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d308e-350b-45b1-a97b-d27f20973fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.319896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d308e-350b-45b1-a97b-d27f20973fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.320753 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d308e-350b-45b1-a97b-d27f20973fe1 None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.domain.id=default, user.id=dbbb04324a8649df81c9f75c69605aae) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:38.321068 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d308e-350b-45b1-a97b-d27f20973fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:38.322587 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d308e-350b-45b1-a97b-d27f20973fe1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:38.328215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabe70e-29b3-42a1-bc2c-d4d1697f5c51 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.329366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Sun Jul 24 00:51:38 2022] GET /identity/v3/role_assignments?user.id=dbbb04324a8649df81c9f75c69605aae&scope.domain.id=default&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:38.363790 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf8d71-57a1-43d3-998d-7dafa536d511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.364518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf8d71-57a1-43d3-998d-7dafa536d511 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.364801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf8d71-57a1-43d3-998d-7dafa536d511 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.365080 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf8d71-57a1-43d3-998d-7dafa536d511 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.365935 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf8d71-57a1-43d3-998d-7dafa536d511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:38.366241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf8d71-57a1-43d3-998d-7dafa536d511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:38.367679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf8d71-57a1-43d3-998d-7dafa536d511 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:38.387774 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:40.555044 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debee87b-939a-4dd5-b940-651c19aaf89d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:40.555579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debee87b-939a-4dd5-b940-651c19aaf89d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:40.555579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debee87b-939a-4dd5-b940-651c19aaf89d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:40.556994 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:40.572169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf3dea-ee5a-4e26-a15c-e4c79fd82e07 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:40.572169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf3dea-ee5a-4e26-a15c-e4c79fd82e07 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:40.572169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf3dea-ee5a-4e26-a15c-e4c79fd82e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:40.598296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b3bf3dea-ee5a-4e26-a15c-e4c79fd82e07 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:40.599535 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b3bf3dea-ee5a-4e26-a15c-e4c79fd82e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:40.695636 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:40.730473 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debee87b-939a-4dd5-b940-651c19aaf89d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:40.849562 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7224b45-8d78-404e-9cd7-a5095bd14023 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:40.849757 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7224b45-8d78-404e-9cd7-a5095bd14023 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:40.850033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7224b45-8d78-404e-9cd7-a5095bd14023 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:40.851546 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:40.857124 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc26d29-8126-4cbb-abd2-4c230c949d15 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:40.857442 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc26d29-8126-4cbb-abd2-4c230c949d15 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:40.857731 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc26d29-8126-4cbb-abd2-4c230c949d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:40.883693 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-bdc26d29-8126-4cbb-abd2-4c230c949d15 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:40.884922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bdc26d29-8126-4cbb-abd2-4c230c949d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:40.891589 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debee87b-939a-4dd5-b940-651c19aaf89d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:40.970255 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd9a31-906c-4147-8c3f-89a5a623ffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:40.971123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd9a31-906c-4147-8c3f-89a5a623ffcf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:40.971408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd9a31-906c-4147-8c3f-89a5a623ffcf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:40.971685 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd9a31-906c-4147-8c3f-89a5a623ffcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:40.988088 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:40.998229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd9a31-906c-4147-8c3f-89a5a623ffcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-27cd9a31-906c-4147-8c3f-89a5a623ffcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:41.006106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:41.008097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:51:41.009997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 13/25] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:51:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:41.019332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd9a31-906c-4147-8c3f-89a5a623ffcf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:41.027920 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:41.048318 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 13/26] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:41.078509 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc26d29-8126-4cbb-abd2-4c230c949d15 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:41.261185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd9a31-906c-4147-8c3f-89a5a623ffcf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:41.305871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc26d29-8126-4cbb-abd2-4c230c949d15 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:41.344050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642c7d3-d1cd-4558-81b5-c1335a21abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:41.344769 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642c7d3-d1cd-4558-81b5-c1335a21abc2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.345054 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642c7d3-d1cd-4558-81b5-c1335a21abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.345373 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642c7d3-d1cd-4558-81b5-c1335a21abc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.346225 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642c7d3-d1cd-4558-81b5-c1335a21abc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:41.346539 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642c7d3-d1cd-4558-81b5-c1335a21abc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:41.348013 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642c7d3-d1cd-4558-81b5-c1335a21abc2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:41.372195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 14/27] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:41.373688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601318b8-1aad-4b19-b033-bd12b5c42163 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.373982 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601318b8-1aad-4b19-b033-bd12b5c42163 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.374266 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601318b8-1aad-4b19-b033-bd12b5c42163 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.375579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 15/28] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:41.379064 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601318b8-1aad-4b19-b033-bd12b5c42163 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:41.393533 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8623f4a-2e6d-475e-9113-6d5688ed41ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:41.394239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8623f4a-2e6d-475e-9113-6d5688ed41ba None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.394527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8623f4a-2e6d-475e-9113-6d5688ed41ba None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.394805 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8623f4a-2e6d-475e-9113-6d5688ed41ba None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.395586 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8623f4a-2e6d-475e-9113-6d5688ed41ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:41.397008 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8623f4a-2e6d-475e-9113-6d5688ed41ba None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:41.485797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:41.524351 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601318b8-1aad-4b19-b033-bd12b5c42163 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:41.559916 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd98ec-e2cf-47cd-8375-171178585695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:41.561726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd98ec-e2cf-47cd-8375-171178585695 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.562298 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd98ec-e2cf-47cd-8375-171178585695 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.562804 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd98ec-e2cf-47cd-8375-171178585695 None admin] PATH_INFO: `/v3/users/dbbb04324a8649df81c9f75c69605aae` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.564310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd98ec-e2cf-47cd-8375-171178585695 None admin] RBAC: Authorizing `identity:get_user(user_id=dbbb04324a8649df81c9f75c69605aae)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:41.566163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd98ec-e2cf-47cd-8375-171178585695 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:41.566997 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 14/29] 10.222.0.43 () {60 vars in 1131 bytes} [Sun Jul 24 00:51:41 2022] POST /identity/v3/roles => generated 219 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:51:41.568246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 16/30] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:41 2022] GET /identity/v3/users/dbbb04324a8649df81c9f75c69605aae => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:41.573627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78530be5-3942-456e-b540-4251f6b90305 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.574123 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78530be5-3942-456e-b540-4251f6b90305 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.574195 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78530be5-3942-456e-b540-4251f6b90305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.576328 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3528-843d-46ec-b135-27a71953c5f6 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.576878 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3528-843d-46ec-b135-27a71953c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.577437 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3528-843d-46ec-b135-27a71953c5f6 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.584699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 17/31] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:41 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:41.585882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df3528-843d-46ec-b135-27a71953c5f6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:41.620788 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-78530be5-3942-456e-b540-4251f6b90305 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:41.624442 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-78530be5-3942-456e-b540-4251f6b90305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:41.671492 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:41.726181 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 15/32] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:41.727625 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541768-fedf-4334-8ff3-41eda9f0f04a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.727915 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541768-fedf-4334-8ff3-41eda9f0f04a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.728483 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541768-fedf-4334-8ff3-41eda9f0f04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.749402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a4541768-fedf-4334-8ff3-41eda9f0f04a None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:41.750853 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a4541768-fedf-4334-8ff3-41eda9f0f04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:41.769185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df3528-843d-46ec-b135-27a71953c5f6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:41.823542 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178fcb3-4aa7-4ee8-bcdb-3962a35f30f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:41.824525 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178fcb3-4aa7-4ee8-bcdb-3962a35f30f4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.824838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178fcb3-4aa7-4ee8-bcdb-3962a35f30f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.825655 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178fcb3-4aa7-4ee8-bcdb-3962a35f30f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.826867 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178fcb3-4aa7-4ee8-bcdb-3962a35f30f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:41.828876 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178fcb3-4aa7-4ee8-bcdb-3962a35f30f4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:41.831329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 18/33] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:41.832127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178fcb3-4aa7-4ee8-bcdb-3962a35f30f4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:41.839257 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:41.860893 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 16/34] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:41.861833 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4541768-fedf-4334-8ff3-41eda9f0f04a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:41.967228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178fcb3-4aa7-4ee8-bcdb-3962a35f30f4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:41.979612 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:41.986300 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4541768-fedf-4334-8ff3-41eda9f0f04a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:42.005763 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18126ac1-c041-47f9-ac68-525a6428c252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:42.006581 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18126ac1-c041-47f9-ac68-525a6428c252 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.006864 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18126ac1-c041-47f9-ac68-525a6428c252 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.007139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18126ac1-c041-47f9-ac68-525a6428c252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.017945 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18126ac1-c041-47f9-ac68-525a6428c252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:42.019448 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18126ac1-c041-47f9-ac68-525a6428c252 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:42.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a81c1-5a42-4172-98c3-996c8ca687ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:42.027767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a81c1-5a42-4172-98c3-996c8ca687ef None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.028239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a81c1-5a42-4172-98c3-996c8ca687ef None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.028954 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a81c1-5a42-4172-98c3-996c8ca687ef None admin] PATH_INFO: `/v3/domains/default/users/dbbb04324a8649df81c9f75c69605aae/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a81c1-5a42-4172-98c3-996c8ca687ef None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=dbbb04324a8649df81c9f75c69605aae, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:42.033494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a81c1-5a42-4172-98c3-996c8ca687ef None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-18126ac1-c041-47f9-ac68-525a6428c252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:51:42.037847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:42.038717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:42.039933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:51:42.039933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:51:42.039933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:51:42.039933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:51:42.039933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 19/35] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:42.039933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18126ac1-c041-47f9-ac68-525a6428c252 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:42.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 17/36] 10.222.0.43 () {58 vars in 1361 bytes} [Sun Jul 24 00:51:41 2022] PUT /identity/v3/domains/default/users/dbbb04324a8649df81c9f75c69605aae/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:51:42.060131 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cfd2d-9d62-427e-90ee-3f35c5228f20 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.060766 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cfd2d-9d62-427e-90ee-3f35c5228f20 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.061244 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cfd2d-9d62-427e-90ee-3f35c5228f20 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.063068 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 18/37] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:42.068394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cfd2d-9d62-427e-90ee-3f35c5228f20 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:42.109848 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:42.173038 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18126ac1-c041-47f9-ac68-525a6428c252 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:42.214740 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da206043-c31b-4bdf-966d-4398b2f0388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:42.215818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da206043-c31b-4bdf-966d-4398b2f0388b None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.216301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da206043-c31b-4bdf-966d-4398b2f0388b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.216772 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da206043-c31b-4bdf-966d-4398b2f0388b None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.217826 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da206043-c31b-4bdf-966d-4398b2f0388b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:42.219636 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da206043-c31b-4bdf-966d-4398b2f0388b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:42.229258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cfd2d-9d62-427e-90ee-3f35c5228f20 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:42.267147 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4a5d9-8e5f-4b34-978e-1d36fb4f94b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:42.267907 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4a5d9-8e5f-4b34-978e-1d36fb4f94b3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.268163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4a5d9-8e5f-4b34-978e-1d36fb4f94b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.268440 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4a5d9-8e5f-4b34-978e-1d36fb4f94b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.269184 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4a5d9-8e5f-4b34-978e-1d36fb4f94b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:42.269517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4a5d9-8e5f-4b34-978e-1d36fb4f94b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:42.270930 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4a5d9-8e5f-4b34-978e-1d36fb4f94b3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:42.285822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 19/38] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:42.290867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c93f3-d452-46e6-a5c0-50cd47c2227a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.291411 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c93f3-d452-46e6-a5c0-50cd47c2227a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.291909 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c93f3-d452-46e6-a5c0-50cd47c2227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.312038 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e64c93f3-d452-46e6-a5c0-50cd47c2227a None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:42.313717 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e64c93f3-d452-46e6-a5c0-50cd47c2227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:42.326207 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:42.351546 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 20/39] 10.222.0.43 () {60 vars in 1131 bytes} [Sun Jul 24 00:51:42 2022] POST /identity/v3/roles => generated 225 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:42.352585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da206043-c31b-4bdf-966d-4398b2f0388b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:42.405978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 20/40] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:42.407683 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ff24a-d1c3-45a0-b750-27bd3e81642f None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ff24a-d1c3-45a0-b750-27bd3e81642f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.408732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ff24a-d1c3-45a0-b750-27bd3e81642f None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.410354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 21/41] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:42.417112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9e09b-9b40-4ea7-b682-4ee7a8db6fb9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.417618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9e09b-9b40-4ea7-b682-4ee7a8db6fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.418038 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9e09b-9b40-4ea7-b682-4ee7a8db6fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.440807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4bb9e09b-9b40-4ea7-b682-4ee7a8db6fb9 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:42.442765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4bb9e09b-9b40-4ea7-b682-4ee7a8db6fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:42.496537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da206043-c31b-4bdf-966d-4398b2f0388b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:42.513067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:42.537222 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010456a4-74c4-43cd-9ecd-d34ea27192c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:42.538052 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010456a4-74c4-43cd-9ecd-d34ea27192c5 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.538412 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010456a4-74c4-43cd-9ecd-d34ea27192c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.538763 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010456a4-74c4-43cd-9ecd-d34ea27192c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.539587 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010456a4-74c4-43cd-9ecd-d34ea27192c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:42.541720 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 22/42] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:42.542315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010456a4-74c4-43cd-9ecd-d34ea27192c5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:42.542565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9e09b-9b40-4ea7-b682-4ee7a8db6fb9 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:42.591178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 21/43] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:51:42 2022] POST /identity/v3/projects => generated 301 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:42.595364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010456a4-74c4-43cd-9ecd-d34ea27192c5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:42.651917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:42.685775 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9e09b-9b40-4ea7-b682-4ee7a8db6fb9 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:42.729496 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163795d-8926-4aff-8042-f984f0a19148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:42.730664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163795d-8926-4aff-8042-f984f0a19148 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.731154 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163795d-8926-4aff-8042-f984f0a19148 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.731633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163795d-8926-4aff-8042-f984f0a19148 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.732656 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163795d-8926-4aff-8042-f984f0a19148 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:42.734497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163795d-8926-4aff-8042-f984f0a19148 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:42.754428 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1131 bytes} [Sun Jul 24 00:51:42 2022] POST /identity/v3/roles => generated 223 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:42.849120 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010456a4-74c4-43cd-9ecd-d34ea27192c5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:42.892758 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6b521-d1bb-4d1a-837f-4ea6f2b288fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:42.893644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6b521-d1bb-4d1a-837f-4ea6f2b288fb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.893941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6b521-d1bb-4d1a-837f-4ea6f2b288fb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.894241 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6b521-d1bb-4d1a-837f-4ea6f2b288fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.895449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6b521-d1bb-4d1a-837f-4ea6f2b288fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:42.896950 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6b521-d1bb-4d1a-837f-4ea6f2b288fb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:42.899044 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 22/45] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:42.904856 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163795d-8926-4aff-8042-f984f0a19148 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:43.022357 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163795d-8926-4aff-8042-f984f0a19148 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:43.054118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5a529-77a4-436c-805f-50912d3b7183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:43.054824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5a529-77a4-436c-805f-50912d3b7183 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:43.055115 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5a529-77a4-436c-805f-50912d3b7183 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:43.055397 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5a529-77a4-436c-805f-50912d3b7183 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:43.056128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5a529-77a4-436c-805f-50912d3b7183 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:43.057644 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5a529-77a4-436c-805f-50912d3b7183 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:43.061983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:43.088399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:51:42 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:44.145240 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27a6ab-ba92-425e-a6d2-1d951d48026a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:44.145789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27a6ab-ba92-425e-a6d2-1d951d48026a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:44.145789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27a6ab-ba92-425e-a6d2-1d951d48026a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:44.147251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 23/47] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:44.152766 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d3fca-8362-4d58-9d94-a3375de61cb4 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:44.153160 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d3fca-8362-4d58-9d94-a3375de61cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:44.153364 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d3fca-8362-4d58-9d94-a3375de61cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:44.171622 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-9b9d3fca-8362-4d58-9d94-a3375de61cb4 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:44.172888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9b9d3fca-8362-4d58-9d94-a3375de61cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:44.244894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 25/48] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:44.268275 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27a6ab-ba92-425e-a6d2-1d951d48026a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:44.307283 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:44.376632 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27a6ab-ba92-425e-a6d2-1d951d48026a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:44.411291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed90af7-298f-48cc-94b8-09d2fa365f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:44.412097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed90af7-298f-48cc-94b8-09d2fa365f2a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:44.412378 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed90af7-298f-48cc-94b8-09d2fa365f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:44.412651 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed90af7-298f-48cc-94b8-09d2fa365f2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:44.422996 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed90af7-298f-48cc-94b8-09d2fa365f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-eed90af7-298f-48cc-94b8-09d2fa365f2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:44.430798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:44.431681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:51:44.432523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 24/49] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:51:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:44.438067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d3fca-8362-4d58-9d94-a3375de61cb4 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:44.540252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d3fca-8362-4d58-9d94-a3375de61cb4 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:44.558002 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:44.579107 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204ff47-6f90-459e-bee1-0da08cb63f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:44.579807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204ff47-6f90-459e-bee1-0da08cb63f41 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:44.580169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204ff47-6f90-459e-bee1-0da08cb63f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:44.580452 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204ff47-6f90-459e-bee1-0da08cb63f41 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:44.581229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204ff47-6f90-459e-bee1-0da08cb63f41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:44.581565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204ff47-6f90-459e-bee1-0da08cb63f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:44.583498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204ff47-6f90-459e-bee1-0da08cb63f41 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:44.596727 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 26/50] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:44.602228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed90af7-298f-48cc-94b8-09d2fa365f2a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:44.698974 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:44.707011 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed90af7-298f-48cc-94b8-09d2fa365f2a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:44.743080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209896-a2c9-45f2-861e-f1344b2a57d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:44.743982 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209896-a2c9-45f2-861e-f1344b2a57d7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:44.744266 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209896-a2c9-45f2-861e-f1344b2a57d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:44.744546 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209896-a2c9-45f2-861e-f1344b2a57d7 None admin] PATH_INFO: `/v3/users/dbbb04324a8649df81c9f75c69605aae` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:44.745912 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02209896-a2c9-45f2-861e-f1344b2a57d7 None admin] RBAC: Authorizing `identity:get_user(user_id=dbbb04324a8649df81c9f75c69605aae)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:44.747398 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02209896-a2c9-45f2-861e-f1344b2a57d7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:44.749040 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 25/51] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:44 2022] GET /identity/v3/users/dbbb04324a8649df81c9f75c69605aae => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:44.754788 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204ff47-6f90-459e-bee1-0da08cb63f41 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:44.973309 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204ff47-6f90-459e-bee1-0da08cb63f41 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:45.010139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b15fcf-ce35-4ec8-8a24-4adb81735f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:45.010952 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b15fcf-ce35-4ec8-8a24-4adb81735f19 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:45.011235 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b15fcf-ce35-4ec8-8a24-4adb81735f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:45.011504 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b15fcf-ce35-4ec8-8a24-4adb81735f19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:45.012792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b15fcf-ce35-4ec8-8a24-4adb81735f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:45.014289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b15fcf-ce35-4ec8-8a24-4adb81735f19 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:45.015891 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 27/52] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:45.021964 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209896-a2c9-45f2-861e-f1344b2a57d7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:45.083868 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d3ee-40eb-4559-9b11-9df39bd2c5e1 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:45.084171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d3ee-40eb-4559-9b11-9df39bd2c5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:45.084471 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d3ee-40eb-4559-9b11-9df39bd2c5e1 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:45.085877 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 28/53] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:45.091300 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c217c-b6b7-46d6-ac66-1a157a0d810f None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:45.091589 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c217c-b6b7-46d6-ac66-1a157a0d810f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:45.092016 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c217c-b6b7-46d6-ac66-1a157a0d810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:45.108338 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e99c217c-b6b7-46d6-ac66-1a157a0d810f None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:45.109565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e99c217c-b6b7-46d6-ac66-1a157a0d810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:45.125147 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209896-a2c9-45f2-861e-f1344b2a57d7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:45.153105 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:45.161503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268238d-5034-4253-b97b-c92df4b003c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:45.162177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268238d-5034-4253-b97b-c92df4b003c1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:45.162467 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268238d-5034-4253-b97b-c92df4b003c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:45.162749 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268238d-5034-4253-b97b-c92df4b003c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:45.163594 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268238d-5034-4253-b97b-c92df4b003c1 None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.domain.id=default, user.id=dbbb04324a8649df81c9f75c69605aae) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:45.163949 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268238d-5034-4253-b97b-c92df4b003c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:45.165451 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268238d-5034-4253-b97b-c92df4b003c1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:45.171319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 26/54] 10.222.0.43 () {56 vars in 1322 bytes} [Sun Jul 24 00:51:45 2022] GET /identity/v3/role_assignments?user.id=dbbb04324a8649df81c9f75c69605aae&scope.domain.id=default&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:45.176755 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 29/55] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:45.200418 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268238d-5034-4253-b97b-c92df4b003c1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:45.239201 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:45.319307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268238d-5034-4253-b97b-c92df4b003c1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:45.355591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c22f9-20f2-4527-852a-c187ed19dbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:45.356403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c22f9-20f2-4527-852a-c187ed19dbff None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:45.356687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c22f9-20f2-4527-852a-c187ed19dbff None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:45.356964 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c22f9-20f2-4527-852a-c187ed19dbff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:45.358286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c22f9-20f2-4527-852a-c187ed19dbff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:45.359820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c22f9-20f2-4527-852a-c187ed19dbff None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:45.361598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 27/56] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:45.367313 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c217c-b6b7-46d6-ac66-1a157a0d810f None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:45.467476 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c217c-b6b7-46d6-ac66-1a157a0d810f None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:45.506061 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a2dee-4fe7-4de5-98c8-d8da75363513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:45.506673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a2dee-4fe7-4de5-98c8-d8da75363513 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:45.506958 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a2dee-4fe7-4de5-98c8-d8da75363513 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:45.507242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a2dee-4fe7-4de5-98c8-d8da75363513 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:45.507954 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a2dee-4fe7-4de5-98c8-d8da75363513 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:45.509445 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a2dee-4fe7-4de5-98c8-d8da75363513 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:45.539714 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 30/57] 10.222.0.43 () {60 vars in 1140 bytes} [Sun Jul 24 00:51:45 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:47.520725 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a21c6-aef1-47a6-b3ee-2b1ffd5bd7c3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:47.521300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a21c6-aef1-47a6-b3ee-2b1ffd5bd7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:47.521300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a21c6-aef1-47a6-b3ee-2b1ffd5bd7c3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:47.522703 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 28/58] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:47.528981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5533a-09cc-4168-880c-4eb02bcc9518 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:47.529716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5533a-09cc-4168-880c-4eb02bcc9518 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:47.529971 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5533a-09cc-4168-880c-4eb02bcc9518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:47.555115 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-41a5533a-09cc-4168-880c-4eb02bcc9518 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:47.556318 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-41a5533a-09cc-4168-880c-4eb02bcc9518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:47.581793 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:47.627772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 31/59] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:47.652382 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a21c6-aef1-47a6-b3ee-2b1ffd5bd7c3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:47.759841 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:47.770029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a21c6-aef1-47a6-b3ee-2b1ffd5bd7c3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:47.807808 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4c22-240d-4505-9030-96324c0441d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:47.808552 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4c22-240d-4505-9030-96324c0441d1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:47.808842 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4c22-240d-4505-9030-96324c0441d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:47.809116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4c22-240d-4505-9030-96324c0441d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:47.810449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4c22-240d-4505-9030-96324c0441d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:47.811928 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4c22-240d-4505-9030-96324c0441d1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:47.813600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 29/60] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:47.819494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5533a-09cc-4168-880c-4eb02bcc9518 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:47.921341 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5533a-09cc-4168-880c-4eb02bcc9518 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:47.956456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19357fd9-b654-4bbd-88be-7d112bcf6960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:47.957121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19357fd9-b654-4bbd-88be-7d112bcf6960 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:47.957438 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19357fd9-b654-4bbd-88be-7d112bcf6960 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:47.957719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19357fd9-b654-4bbd-88be-7d112bcf6960 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:47.958440 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19357fd9-b654-4bbd-88be-7d112bcf6960 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:47.959898 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19357fd9-b654-4bbd-88be-7d112bcf6960 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:47.987918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 32/61] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:51:47 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:51.086749 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919aad-b960-44f9-ba4e-f20b73ec3428 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.088063 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919aad-b960-44f9-ba4e-f20b73ec3428 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.088526 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919aad-b960-44f9-ba4e-f20b73ec3428 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.090128 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 30/62] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:51.095367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c122d8-d5f5-430a-90d7-2f6fd0286c30 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.096148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c122d8-d5f5-430a-90d7-2f6fd0286c30 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.096616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c122d8-d5f5-430a-90d7-2f6fd0286c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.122228 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-f4c122d8-d5f5-430a-90d7-2f6fd0286c30 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:51.123735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f4c122d8-d5f5-430a-90d7-2f6fd0286c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:51.135956 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:51.206747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 33/63] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:51.233132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aea1cf-135f-4e14-b71e-430706cd60fa None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.233748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aea1cf-135f-4e14-b71e-430706cd60fa None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.234260 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aea1cf-135f-4e14-b71e-430706cd60fa None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.236022 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 31/64] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:51.241700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fabdc-419b-4e23-8dd1-0633fcc26331 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.242236 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fabdc-419b-4e23-8dd1-0633fcc26331 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.242704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fabdc-419b-4e23-8dd1-0633fcc26331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.253235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aea1cf-135f-4e14-b71e-430706cd60fa None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:51.262845 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a43fabdc-419b-4e23-8dd1-0633fcc26331 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:51.264057 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a43fabdc-419b-4e23-8dd1-0633fcc26331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:51.348536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 34/65] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:51.350301 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64110d-74a8-4e90-a03c-c26695be7d42 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.350714 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64110d-74a8-4e90-a03c-c26695be7d42 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.351461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64110d-74a8-4e90-a03c-c26695be7d42 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.353140 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 35/66] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:51.362620 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb640c2e-bb62-440f-a946-6b7dbf60ca7a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.362910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb640c2e-bb62-440f-a946-6b7dbf60ca7a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.363195 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb640c2e-bb62-440f-a946-6b7dbf60ca7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.387225 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aea1cf-135f-4e14-b71e-430706cd60fa None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:51.388135 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fb640c2e-bb62-440f-a946-6b7dbf60ca7a None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:51.389740 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fb640c2e-bb62-440f-a946-6b7dbf60ca7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:51.428050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d5ed1-aaed-4109-a68a-de66aeaeb51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:51.429176 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d5ed1-aaed-4109-a68a-de66aeaeb51c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.429668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d5ed1-aaed-4109-a68a-de66aeaeb51c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.430111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d5ed1-aaed-4109-a68a-de66aeaeb51c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.444011 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d5ed1-aaed-4109-a68a-de66aeaeb51c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9f0d5ed1-aaed-4109-a68a-de66aeaeb51c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:51.454790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:51.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:51.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:51.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:51.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:51.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:51.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:51.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:51.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:51.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:51.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:51.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:51.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:51.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:51:51.458757 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 32/67] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:51.459406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d5ed1-aaed-4109-a68a-de66aeaeb51c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:51.464536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 36/68] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:51.474370 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb640c2e-bb62-440f-a946-6b7dbf60ca7a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:51.484977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:51.494438 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:51.586771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d5ed1-aaed-4109-a68a-de66aeaeb51c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:51.615233 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb640c2e-bb62-440f-a946-6b7dbf60ca7a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:51.623904 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7beff-eefd-47f0-8b7b-e0638507f141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:51.625263 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7beff-eefd-47f0-8b7b-e0638507f141 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.625711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7beff-eefd-47f0-8b7b-e0638507f141 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.626406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7beff-eefd-47f0-8b7b-e0638507f141 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.639724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7beff-eefd-47f0-8b7b-e0638507f141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-d7a7beff-eefd-47f0-8b7b-e0638507f141 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:51.648071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:51.649085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:51:51.649927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 33/69] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:51.650653 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7beff-eefd-47f0-8b7b-e0638507f141 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:51.659189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1ac65-2c00-47fc-ab9c-e601d5349f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:51.659889 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1ac65-2c00-47fc-ab9c-e601d5349f27 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.660177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1ac65-2c00-47fc-ab9c-e601d5349f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.660459 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1ac65-2c00-47fc-ab9c-e601d5349f27 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.661266 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1ac65-2c00-47fc-ab9c-e601d5349f27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:51.661598 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1ac65-2c00-47fc-ab9c-e601d5349f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:51.663016 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1ac65-2c00-47fc-ab9c-e601d5349f27 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:51.671818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 37/70] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:51.673050 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4717f03-9563-43c7-93cd-bbe6e836d268 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.673366 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4717f03-9563-43c7-93cd-bbe6e836d268 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.673642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4717f03-9563-43c7-93cd-bbe6e836d268 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.677307 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 38/71] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:51.677307 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4717f03-9563-43c7-93cd-bbe6e836d268 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:51.747600 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:51.749501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:51.771151 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7beff-eefd-47f0-8b7b-e0638507f141 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:51.787456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4717f03-9563-43c7-93cd-bbe6e836d268 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:51.806349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f612a5c-73d6-48e5-92d8-0cfe6a5f94db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:51.807181 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f612a5c-73d6-48e5-92d8-0cfe6a5f94db None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.807471 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f612a5c-73d6-48e5-92d8-0cfe6a5f94db None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.807792 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f612a5c-73d6-48e5-92d8-0cfe6a5f94db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.818469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f612a5c-73d6-48e5-92d8-0cfe6a5f94db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:51.821896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179ec37-098d-4bae-9a3b-472cf583b140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:51.822578 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179ec37-098d-4bae-9a3b-472cf583b140 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.822864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179ec37-098d-4bae-9a3b-472cf583b140 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.823139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179ec37-098d-4bae-9a3b-472cf583b140 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.823889 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179ec37-098d-4bae-9a3b-472cf583b140 None admin] RBAC: Adding query filter params (name=member) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:51.824196 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179ec37-098d-4bae-9a3b-472cf583b140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:51.825631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179ec37-098d-4bae-9a3b-472cf583b140 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-3f612a5c-73d6-48e5-92d8-0cfe6a5f94db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:51.826573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:51.827370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 34/72] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:51:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:51.833228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f612a5c-73d6-48e5-92d8-0cfe6a5f94db None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:51.841846 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 39/73] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:51:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:51.846721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeaba8-958e-4861-9280-0c9de2e91d6c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.847018 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeaba8-958e-4861-9280-0c9de2e91d6c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.847294 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeaba8-958e-4861-9280-0c9de2e91d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.863765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-9dbeaba8-958e-4861-9280-0c9de2e91d6c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:51.864969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9dbeaba8-958e-4861-9280-0c9de2e91d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:51.929226 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f612a5c-73d6-48e5-92d8-0cfe6a5f94db None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:51.929385 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 40/74] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:51.930164 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbeaba8-958e-4861-9280-0c9de2e91d6c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:51.963823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4743d-f6ad-40e7-a1d7-99aa64b0351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:51.964709 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4743d-f6ad-40e7-a1d7-99aa64b0351d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.964992 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4743d-f6ad-40e7-a1d7-99aa64b0351d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.965296 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4743d-f6ad-40e7-a1d7-99aa64b0351d None admin] PATH_INFO: `/v3/users/dbbb04324a8649df81c9f75c69605aae` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.966497 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4743d-f6ad-40e7-a1d7-99aa64b0351d None admin] RBAC: Authorizing `identity:get_user(user_id=dbbb04324a8649df81c9f75c69605aae)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:51.967964 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4743d-f6ad-40e7-a1d7-99aa64b0351d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:51.969634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 35/75] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:51 2022] GET /identity/v3/users/dbbb04324a8649df81c9f75c69605aae => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:51.970966 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aee67-795c-4e85-85a1-324b2ab71d35 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.971253 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aee67-795c-4e85-85a1-324b2ab71d35 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.971552 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aee67-795c-4e85-85a1-324b2ab71d35 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.972753 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 36/76] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:51.973556 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aee67-795c-4e85-85a1-324b2ab71d35 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:51.985846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:51.990898 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:52.032541 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbeaba8-958e-4861-9280-0c9de2e91d6c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:52.067029 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2351c43-cde1-48e5-ab13-42183e2e3460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:52.067736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2351c43-cde1-48e5-ab13-42183e2e3460 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:52.068021 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2351c43-cde1-48e5-ab13-42183e2e3460 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:52.068297 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2351c43-cde1-48e5-ab13-42183e2e3460 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:52.069054 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2351c43-cde1-48e5-ab13-42183e2e3460 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:52.069393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2351c43-cde1-48e5-ab13-42183e2e3460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:52.070809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2351c43-cde1-48e5-ab13-42183e2e3460 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:52.076262 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aee67-795c-4e85-85a1-324b2ab71d35 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:52.078981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 41/77] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:51:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:52.079782 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2351c43-cde1-48e5-ab13-42183e2e3460 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:52.110094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0daabc-4cf2-44fd-b7d8-a23c1f25bb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:52.110977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0daabc-4cf2-44fd-b7d8-a23c1f25bb24 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:52.111261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0daabc-4cf2-44fd-b7d8-a23c1f25bb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:52.111561 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0daabc-4cf2-44fd-b7d8-a23c1f25bb24 None admin] PATH_INFO: `/v3/users/21b09299f25d4591a38f3b193aad3d4d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:52.125643 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0daabc-4cf2-44fd-b7d8-a23c1f25bb24 None admin] RBAC: Authorizing `identity:get_user(user_id=21b09299f25d4591a38f3b193aad3d4d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:52.127175 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0daabc-4cf2-44fd-b7d8-a23c1f25bb24 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:52.128877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 37/78] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:51 2022] GET /identity/v3/users/21b09299f25d4591a38f3b193aad3d4d => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:52.130140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21096408-8e46-465c-a148-ab346178a208 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:52.130431 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21096408-8e46-465c-a148-ab346178a208 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:52.130713 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21096408-8e46-465c-a148-ab346178a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:52.146809 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-21096408-8e46-465c-a148-ab346178a208 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:52.148332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-21096408-8e46-465c-a148-ab346178a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:52.183668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2351c43-cde1-48e5-ab13-42183e2e3460 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:52.205917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:52.209181 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:52.215711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 38/79] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:52.216677 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21096408-8e46-465c-a148-ab346178a208 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:52.218305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288193e-b298-4c23-8278-57f8e8480530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:52.219267 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288193e-b298-4c23-8278-57f8e8480530 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:52.219563 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288193e-b298-4c23-8278-57f8e8480530 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:52.219844 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288193e-b298-4c23-8278-57f8e8480530 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:52.239700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288193e-b298-4c23-8278-57f8e8480530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-a288193e-b298-4c23-8278-57f8e8480530 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:52.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:52.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:51:52.250413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 42/80] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:52.251044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288193e-b298-4c23-8278-57f8e8480530 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:52.313755 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21096408-8e46-465c-a148-ab346178a208 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:52.346421 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288193e-b298-4c23-8278-57f8e8480530 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:52.347111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7171fdc-9bd3-47e6-b2b8-0a721ae5a17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:52.347829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7171fdc-9bd3-47e6-b2b8-0a721ae5a17c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:52.348121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7171fdc-9bd3-47e6-b2b8-0a721ae5a17c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:52.348426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7171fdc-9bd3-47e6-b2b8-0a721ae5a17c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:52.380375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c33ecb-0d77-44fd-beee-225027031f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:52.381283 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c33ecb-0d77-44fd-beee-225027031f88 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:52.381571 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c33ecb-0d77-44fd-beee-225027031f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:52.381847 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c33ecb-0d77-44fd-beee-225027031f88 None admin] PATH_INFO: `/v3/users/21b09299f25d4591a38f3b193aad3d4d` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:52.383034 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c33ecb-0d77-44fd-beee-225027031f88 None admin] RBAC: Authorizing `identity:get_user(user_id=21b09299f25d4591a38f3b193aad3d4d)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:52.384504 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c33ecb-0d77-44fd-beee-225027031f88 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:52.386184 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 43/81] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:52 2022] GET /identity/v3/users/21b09299f25d4591a38f3b193aad3d4d => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:52.386941 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c33ecb-0d77-44fd-beee-225027031f88 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:52.415676 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:52.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7171fdc-9bd3-47e6-b2b8-0a721ae5a17c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:52.421330 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7171fdc-9bd3-47e6-b2b8-0a721ae5a17c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:52.438152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:52.494443 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c33ecb-0d77-44fd-beee-225027031f88 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:52.518224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 39/82] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:51:52.519159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7171fdc-9bd3-47e6-b2b8-0a721ae5a17c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:52.533184 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45605a3-4316-449c-85cf-ccf1d0128e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:52.533996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45605a3-4316-449c-85cf-ccf1d0128e28 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:52.534280 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45605a3-4316-449c-85cf-ccf1d0128e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:52.534552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45605a3-4316-449c-85cf-ccf1d0128e28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:52.602433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45605a3-4316-449c-85cf-ccf1d0128e28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:52.603939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45605a3-4316-449c-85cf-ccf1d0128e28 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:52.620592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:52.624344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7171fdc-9bd3-47e6-b2b8-0a721ae5a17c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:52.651997 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:52.657392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ab0ae-bd45-4af5-82b7-13b0bc86ed8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:52.658208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ab0ae-bd45-4af5-82b7-13b0bc86ed8f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:52.658545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ab0ae-bd45-4af5-82b7-13b0bc86ed8f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:52.658820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ab0ae-bd45-4af5-82b7-13b0bc86ed8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:52.660029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ab0ae-bd45-4af5-82b7-13b0bc86ed8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:52.661525 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ab0ae-bd45-4af5-82b7-13b0bc86ed8f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:52.663386 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 40/83] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:52.663951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ab0ae-bd45-4af5-82b7-13b0bc86ed8f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:52.704361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 44/84] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:51:52.705959 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45605a3-4316-449c-85cf-ccf1d0128e28 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:52.763938 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ab0ae-bd45-4af5-82b7-13b0bc86ed8f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:52.799461 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee467bca-2cf1-469e-ab78-6a20f44079aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:52.800150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee467bca-2cf1-469e-ab78-6a20f44079aa None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:52.800437 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee467bca-2cf1-469e-ab78-6a20f44079aa None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:52.800714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee467bca-2cf1-469e-ab78-6a20f44079aa None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:52.801512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee467bca-2cf1-469e-ab78-6a20f44079aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:52.801829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee467bca-2cf1-469e-ab78-6a20f44079aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:52.802390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45605a3-4316-449c-85cf-ccf1d0128e28 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:52.803269 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee467bca-2cf1-469e-ab78-6a20f44079aa None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:52.812443 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 41/85] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:51:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:52.813269 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee467bca-2cf1-469e-ab78-6a20f44079aa None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:52.836083 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a14a1-f724-4c93-9536-92d141dedd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:52.836736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a14a1-f724-4c93-9536-92d141dedd0b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:52.837505 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a14a1-f724-4c93-9536-92d141dedd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:52.837784 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a14a1-f724-4c93-9536-92d141dedd0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:52.843600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:52.856205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:52.904275 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a14a1-f724-4c93-9536-92d141dedd0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:52.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a14a1-f724-4c93-9536-92d141dedd0b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:52.914587 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee467bca-2cf1-469e-ab78-6a20f44079aa None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:52.947031 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2fecf-0d38-4668-8bc1-83021c9bacd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:52.947904 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2fecf-0d38-4668-8bc1-83021c9bacd9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:52.948185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2fecf-0d38-4668-8bc1-83021c9bacd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:52.948458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2fecf-0d38-4668-8bc1-83021c9bacd9 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:52.949694 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2fecf-0d38-4668-8bc1-83021c9bacd9 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:52.951165 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2fecf-0d38-4668-8bc1-83021c9bacd9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:52.953059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 42/86] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:52 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:52.953656 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2fecf-0d38-4668-8bc1-83021c9bacd9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:53.006945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 45/87] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:51:53.007724 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a14a1-f724-4c93-9536-92d141dedd0b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:53.045863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:53.052122 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2fecf-0d38-4668-8bc1-83021c9bacd9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:53.059524 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:53.088596 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c0b8a-c569-4088-b4a4-95c5d61e15fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:53.089571 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c0b8a-c569-4088-b4a4-95c5d61e15fa None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.089875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c0b8a-c569-4088-b4a4-95c5d61e15fa None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.090125 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c0b8a-c569-4088-b4a4-95c5d61e15fa None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.090850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c0b8a-c569-4088-b4a4-95c5d61e15fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:53.092306 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c0b8a-c569-4088-b4a4-95c5d61e15fa None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:53.111326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a14a1-f724-4c93-9536-92d141dedd0b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:53.119456 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 43/88] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:51:52 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:53.120783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c0b8a-c569-4088-b4a4-95c5d61e15fa None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:53.149623 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b401fa-074f-404d-93c0-369a740605bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:53.150839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b401fa-074f-404d-93c0-369a740605bf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.151451 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b401fa-074f-404d-93c0-369a740605bf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.151451 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b401fa-074f-404d-93c0-369a740605bf None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.152897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b401fa-074f-404d-93c0-369a740605bf None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:53.154530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b401fa-074f-404d-93c0-369a740605bf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:53.161544 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 46/89] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:53 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:53.161544 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b401fa-074f-404d-93c0-369a740605bf None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:53.245055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c0b8a-c569-4088-b4a4-95c5d61e15fa None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:53.271989 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b401fa-074f-404d-93c0-369a740605bf None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:53.289268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f142909-0321-4c66-b461-405f0300a2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:53.290172 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f142909-0321-4c66-b461-405f0300a2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.290458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f142909-0321-4c66-b461-405f0300a2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.290739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f142909-0321-4c66-b461-405f0300a2d9 None admin] PATH_INFO: `/v3/users/21b09299f25d4591a38f3b193aad3d4d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.292350 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:53.293011 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f142909-0321-4c66-b461-405f0300a2d9 None admin] RBAC: Authorizing `identity:get_user(user_id=21b09299f25d4591a38f3b193aad3d4d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:53.294538 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f142909-0321-4c66-b461-405f0300a2d9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:53.300998 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 44/90] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:53 2022] GET /identity/v3/users/21b09299f25d4591a38f3b193aad3d4d => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:53.300998 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f142909-0321-4c66-b461-405f0300a2d9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:53.318285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a0e7-011b-465e-9f27-d275fec3822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:53.319018 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a0e7-011b-465e-9f27-d275fec3822d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.319305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a0e7-011b-465e-9f27-d275fec3822d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.319772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a0e7-011b-465e-9f27-d275fec3822d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.321007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a0e7-011b-465e-9f27-d275fec3822d None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=4a8d6d084fc142bf96584a8573fbabd6, user.id=dbbb04324a8649df81c9f75c69605aae) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:53.321409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a0e7-011b-465e-9f27-d275fec3822d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:53.322897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a0e7-011b-465e-9f27-d275fec3822d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:53.328858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:53.332378 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 47/91] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:51:53 2022] GET /identity/v3/role_assignments?user.id=dbbb04324a8649df81c9f75c69605aae&scope.project.id=4a8d6d084fc142bf96584a8573fbabd6&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:53.333319 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a0e7-011b-465e-9f27-d275fec3822d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:53.451033 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f142909-0321-4c66-b461-405f0300a2d9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:53.482480 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a0e7-011b-465e-9f27-d275fec3822d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:53.502147 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556365dc-98e8-496b-b2ce-aca761d550c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:53.503421 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556365dc-98e8-496b-b2ce-aca761d550c9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.503727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556365dc-98e8-496b-b2ce-aca761d550c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.504015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556365dc-98e8-496b-b2ce-aca761d550c9 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.505456 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556365dc-98e8-496b-b2ce-aca761d550c9 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:53.506971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556365dc-98e8-496b-b2ce-aca761d550c9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:53.513233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 45/92] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:53 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:53.513233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556365dc-98e8-496b-b2ce-aca761d550c9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:53.529841 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a624e2-b201-4303-9fc1-d7e84af11124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:53.530892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a624e2-b201-4303-9fc1-d7e84af11124 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.531418 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a624e2-b201-4303-9fc1-d7e84af11124 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.531890 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a624e2-b201-4303-9fc1-d7e84af11124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.532929 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a624e2-b201-4303-9fc1-d7e84af11124 None admin] RBAC: Adding query filter params (role.id=2099e2212de24144b089730e7db8ed3a, scope.project.id=4a8d6d084fc142bf96584a8573fbabd6, user.id=21b09299f25d4591a38f3b193aad3d4d) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:53.533526 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a624e2-b201-4303-9fc1-d7e84af11124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:53.535205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a624e2-b201-4303-9fc1-d7e84af11124 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:53.541466 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 48/93] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:51:53 2022] GET /identity/v3/role_assignments?user.id=21b09299f25d4591a38f3b193aad3d4d&scope.project.id=4a8d6d084fc142bf96584a8573fbabd6&role.id=2099e2212de24144b089730e7db8ed3a => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:53.544843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a624e2-b201-4303-9fc1-d7e84af11124 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:53.618000 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:53.632432 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556365dc-98e8-496b-b2ce-aca761d550c9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:53.661699 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:53.670455 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a58306-c2e2-4b2e-b971-89de59a23641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:53.671137 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a58306-c2e2-4b2e-b971-89de59a23641 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.671433 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a58306-c2e2-4b2e-b971-89de59a23641 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.671734 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a58306-c2e2-4b2e-b971-89de59a23641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.746936 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a58306-c2e2-4b2e-b971-89de59a23641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:53.748517 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a58306-c2e2-4b2e-b971-89de59a23641 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:53.768973 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a624e2-b201-4303-9fc1-d7e84af11124 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:53.843027 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4154d-ce42-4edb-839c-caba99c4b4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:53.843629 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4154d-ce42-4edb-839c-caba99c4b4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.843923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4154d-ce42-4edb-839c-caba99c4b4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.844212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4154d-ce42-4edb-839c-caba99c4b4e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.845070 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4154d-ce42-4edb-839c-caba99c4b4e1 None admin] RBAC: Adding query filter params (role.id=d91e55b589bd4b9aaab2ab607f087f8d, scope.project.id=4a8d6d084fc142bf96584a8573fbabd6, user.id=21b09299f25d4591a38f3b193aad3d4d) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:53.845414 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4154d-ce42-4edb-839c-caba99c4b4e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:53.846962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4154d-ce42-4edb-839c-caba99c4b4e1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:53.863560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 49/94] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:51:53 2022] GET /identity/v3/role_assignments?user.id=21b09299f25d4591a38f3b193aad3d4d&scope.project.id=4a8d6d084fc142bf96584a8573fbabd6&role.id=d91e55b589bd4b9aaab2ab607f087f8d => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:53.892313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:53.906762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 46/95] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:51:53.912768 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4154d-ce42-4edb-839c-caba99c4b4e1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:54.043212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4154d-ce42-4edb-839c-caba99c4b4e1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:54.070041 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:54.122763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9b20c-337c-4969-bffd-f3613d23ea7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:54.123589 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9b20c-337c-4969-bffd-f3613d23ea7e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:54.123882 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9b20c-337c-4969-bffd-f3613d23ea7e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:54.124163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9b20c-337c-4969-bffd-f3613d23ea7e None admin] PATH_INFO: `/v3/projects/ac7846253ff8494cb07a57b9fef377e7` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:54.128884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9b20c-337c-4969-bffd-f3613d23ea7e None admin] RBAC: Authorizing `identity:get_project(project_id=ac7846253ff8494cb07a57b9fef377e7)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:54.128884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9b20c-337c-4969-bffd-f3613d23ea7e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:54.128884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 50/96] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:53 2022] GET /identity/v3/projects/ac7846253ff8494cb07a57b9fef377e7 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:54.137256 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a58306-c2e2-4b2e-b971-89de59a23641 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:54.291113 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a58306-c2e2-4b2e-b971-89de59a23641 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:54.349926 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a86ab-a891-48f8-af45-adaebfc00984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:54.350614 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a86ab-a891-48f8-af45-adaebfc00984 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:54.350905 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a86ab-a891-48f8-af45-adaebfc00984 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:54.351188 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a86ab-a891-48f8-af45-adaebfc00984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:54.352049 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a86ab-a891-48f8-af45-adaebfc00984 None admin] RBAC: Adding query filter params (role.id=2099e2212de24144b089730e7db8ed3a, scope.project.id=ac7846253ff8494cb07a57b9fef377e7, user.id=21b09299f25d4591a38f3b193aad3d4d) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:54.352367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a86ab-a891-48f8-af45-adaebfc00984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:54.353879 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a86ab-a891-48f8-af45-adaebfc00984 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:54.360207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 47/97] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:51:54 2022] GET /identity/v3/role_assignments?user.id=21b09299f25d4591a38f3b193aad3d4d&scope.project.id=ac7846253ff8494cb07a57b9fef377e7&role.id=2099e2212de24144b089730e7db8ed3a => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:56.294824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8f2d0-d98e-4d8a-9b18-a407c24662ad None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.295345 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8f2d0-d98e-4d8a-9b18-a407c24662ad None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.295419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8f2d0-d98e-4d8a-9b18-a407c24662ad None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.296969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 51/98] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:56.315252 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9cd1f-2006-431e-9263-36f5521f0f9f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.315746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9cd1f-2006-431e-9263-36f5521f0f9f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.315822 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9cd1f-2006-431e-9263-36f5521f0f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.338566 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7fd9cd1f-2006-431e-9263-36f5521f0f9f None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:56.339793 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7fd9cd1f-2006-431e-9263-36f5521f0f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:56.389609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:56.410870 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 48/99] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:56.433405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8f2d0-d98e-4d8a-9b18-a407c24662ad None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:56.547757 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8f2d0-d98e-4d8a-9b18-a407c24662ad None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:56.589223 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe407e4-8773-4e55-bf87-401249f6648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:56.589223 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe407e4-8773-4e55-bf87-401249f6648d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.589223 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe407e4-8773-4e55-bf87-401249f6648d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.589223 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe407e4-8773-4e55-bf87-401249f6648d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.599349 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe407e4-8773-4e55-bf87-401249f6648d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-4fe407e4-8773-4e55-bf87-401249f6648d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:56.611558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:56.612422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:51:56.613646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 52/100] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:56.618776 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9cd1f-2006-431e-9263-36f5521f0f9f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:56.632429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e70b21-aef5-4c0d-9249-70b2fb396fa0 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.632726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e70b21-aef5-4c0d-9249-70b2fb396fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.633013 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e70b21-aef5-4c0d-9249-70b2fb396fa0 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.634619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 53/101] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:56.650123 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cda4a-f3cf-4fb7-a4eb-efcf25377316 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.650562 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cda4a-f3cf-4fb7-a4eb-efcf25377316 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.650845 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cda4a-f3cf-4fb7-a4eb-efcf25377316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.675860 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-bf1cda4a-f3cf-4fb7-a4eb-efcf25377316 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:56.677094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bf1cda4a-f3cf-4fb7-a4eb-efcf25377316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:56.712152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:56.758614 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 54/102] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:56.760071 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0ff5c-0c42-414b-beeb-29bb442f7a0d None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.760379 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0ff5c-0c42-414b-beeb-29bb442f7a0d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.760660 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0ff5c-0c42-414b-beeb-29bb442f7a0d None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.762661 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 55/103] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:56.763619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34ec85-07df-4a7f-9bf6-578440922b89 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.763872 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34ec85-07df-4a7f-9bf6-578440922b89 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.764155 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34ec85-07df-4a7f-9bf6-578440922b89 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.766873 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 56/104] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:56.770749 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75acf2-5cce-4275-97c5-c4857f4b0981 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.771048 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75acf2-5cce-4275-97c5-c4857f4b0981 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.771320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75acf2-5cce-4275-97c5-c4857f4b0981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.800793 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-9d75acf2-5cce-4275-97c5-c4857f4b0981 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:56.802187 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9d75acf2-5cce-4275-97c5-c4857f4b0981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:56.809445 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9cd1f-2006-431e-9263-36f5521f0f9f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:56.847814 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11585f-6e8c-49dc-9846-f160e8711a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:56.848497 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11585f-6e8c-49dc-9846-f160e8711a73 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.848784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11585f-6e8c-49dc-9846-f160e8711a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.849061 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11585f-6e8c-49dc-9846-f160e8711a73 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.849865 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11585f-6e8c-49dc-9846-f160e8711a73 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:56.850174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11585f-6e8c-49dc-9846-f160e8711a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:56.852116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11585f-6e8c-49dc-9846-f160e8711a73 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:56.861174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 49/105] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:51:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:56.862540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b8fd4-ca58-40b0-8b6d-11f228ecb27b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.862832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b8fd4-ca58-40b0-8b6d-11f228ecb27b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.863110 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b8fd4-ca58-40b0-8b6d-11f228ecb27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.881000 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-043b8fd4-ca58-40b0-8b6d-11f228ecb27b None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:56.882230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-043b8fd4-ca58-40b0-8b6d-11f228ecb27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:56.893245 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 57/106] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:56.893245 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75acf2-5cce-4275-97c5-c4857f4b0981 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:56.936848 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:56.965238 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 50/107] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:56.973479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9499bf0-62a5-4fe5-8f0f-70e5780e9b37 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.973479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9499bf0-62a5-4fe5-8f0f-70e5780e9b37 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.973479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9499bf0-62a5-4fe5-8f0f-70e5780e9b37 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.973479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 51/108] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:56.973479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9499bf0-62a5-4fe5-8f0f-70e5780e9b37 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.007116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:57.010989 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75acf2-5cce-4275-97c5-c4857f4b0981 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.049007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5841d9-b327-4621-8ded-11f41f163028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.049905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5841d9-b327-4621-8ded-11f41f163028 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.050191 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5841d9-b327-4621-8ded-11f41f163028 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.050469 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5841d9-b327-4621-8ded-11f41f163028 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.061614 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5841d9-b327-4621-8ded-11f41f163028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-fe5841d9-b327-4621-8ded-11f41f163028 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:57.069281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:57.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:51:57.070925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 58/109] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:51:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:57.072201 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5841d9-b327-4621-8ded-11f41f163028 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.083555 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9499bf0-62a5-4fe5-8f0f-70e5780e9b37 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.126949 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d5be3-ff6a-4da4-838d-55fdd768d157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.127878 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d5be3-ff6a-4da4-838d-55fdd768d157 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.128170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d5be3-ff6a-4da4-838d-55fdd768d157 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.128446 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d5be3-ff6a-4da4-838d-55fdd768d157 None admin] PATH_INFO: `/v3/users/21b09299f25d4591a38f3b193aad3d4d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.129732 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d5be3-ff6a-4da4-838d-55fdd768d157 None admin] RBAC: Authorizing `identity:get_user(user_id=21b09299f25d4591a38f3b193aad3d4d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.131220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d5be3-ff6a-4da4-838d-55fdd768d157 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:57.137313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 52/110] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:56 2022] GET /identity/v3/users/21b09299f25d4591a38f3b193aad3d4d => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:57.137313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75399a0-d394-468e-a541-68d152bb8980 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.137313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75399a0-d394-468e-a541-68d152bb8980 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.137313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75399a0-d394-468e-a541-68d152bb8980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.153175 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c75399a0-d394-468e-a541-68d152bb8980 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:57.154397 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c75399a0-d394-468e-a541-68d152bb8980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:57.184806 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5841d9-b327-4621-8ded-11f41f163028 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.190241 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:57.226357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 53/111] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:57.227021 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75399a0-d394-468e-a541-68d152bb8980 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.231079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8b95a-6b69-49b5-8d3e-b4fc88d16326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.232159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8b95a-6b69-49b5-8d3e-b4fc88d16326 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.232642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8b95a-6b69-49b5-8d3e-b4fc88d16326 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.233111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8b95a-6b69-49b5-8d3e-b4fc88d16326 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.247568 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8b95a-6b69-49b5-8d3e-b4fc88d16326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-dda8b95a-6b69-49b5-8d3e-b4fc88d16326 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:57.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:57.259454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:57.260227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:57.260227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:57.260227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:57.260227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:57.260227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:57.260227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:57.260227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:57.260227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:57.260227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:57.260227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:57.260227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:51:57.260227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:51:57.266692 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 59/112] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:57.266692 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8b95a-6b69-49b5-8d3e-b4fc88d16326 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.289596 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:57.339153 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75399a0-d394-468e-a541-68d152bb8980 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.370913 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8b95a-6b69-49b5-8d3e-b4fc88d16326 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.372039 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12a47-5f1b-4c4f-955e-eb393fa0bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.372947 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12a47-5f1b-4c4f-955e-eb393fa0bbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.373269 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12a47-5f1b-4c4f-955e-eb393fa0bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.373590 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12a47-5f1b-4c4f-955e-eb393fa0bbd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.374763 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a12a47-5f1b-4c4f-955e-eb393fa0bbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.376312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a12a47-5f1b-4c4f-955e-eb393fa0bbd8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:57.382545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 54/113] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:57.382545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12a47-5f1b-4c4f-955e-eb393fa0bbd8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.403900 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89990a-a81d-4b94-9711-ba860a4c671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.404578 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89990a-a81d-4b94-9711-ba860a4c671a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.404864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89990a-a81d-4b94-9711-ba860a4c671a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.405140 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89990a-a81d-4b94-9711-ba860a4c671a None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.405941 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89990a-a81d-4b94-9711-ba860a4c671a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:57.406244 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89990a-a81d-4b94-9711-ba860a4c671a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.407645 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89990a-a81d-4b94-9711-ba860a4c671a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:57.415672 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 60/114] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:57.421085 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89990a-a81d-4b94-9711-ba860a4c671a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.422581 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:57.482351 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12a47-5f1b-4c4f-955e-eb393fa0bbd8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.500051 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:57.515587 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5b79-d619-43e8-9ce8-76794e42d258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.516465 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5b79-d619-43e8-9ce8-76794e42d258 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.516751 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5b79-d619-43e8-9ce8-76794e42d258 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.517065 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5b79-d619-43e8-9ce8-76794e42d258 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.518293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd5b79-d619-43e8-9ce8-76794e42d258 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.519750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89990a-a81d-4b94-9711-ba860a4c671a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.519883 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd5b79-d619-43e8-9ce8-76794e42d258 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:57.521733 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 55/115] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:57 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:57.522259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5b79-d619-43e8-9ce8-76794e42d258 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.557995 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e044-1740-4f5a-95bb-1b022b10568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.558814 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e044-1740-4f5a-95bb-1b022b10568b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.559098 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e044-1740-4f5a-95bb-1b022b10568b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.559373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e044-1740-4f5a-95bb-1b022b10568b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.569341 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379e044-1740-4f5a-95bb-1b022b10568b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-7379e044-1740-4f5a-95bb-1b022b10568b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:57.577539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:57.578467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:51:57.579229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 61/116] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:51:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:57.580022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08832f-aa32-4295-bebc-6a2f5625f757 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.580336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08832f-aa32-4295-bebc-6a2f5625f757 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.580616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08832f-aa32-4295-bebc-6a2f5625f757 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.582038 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 62/117] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:57.582575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08832f-aa32-4295-bebc-6a2f5625f757 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.626320 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5b79-d619-43e8-9ce8-76794e42d258 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.635761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:57.660597 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab858c4a-4d36-4a27-9c16-72dd1ef1fb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.661409 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab858c4a-4d36-4a27-9c16-72dd1ef1fb4a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.661700 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab858c4a-4d36-4a27-9c16-72dd1ef1fb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.661976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab858c4a-4d36-4a27-9c16-72dd1ef1fb4a None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.662737 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab858c4a-4d36-4a27-9c16-72dd1ef1fb4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:57.663046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab858c4a-4d36-4a27-9c16-72dd1ef1fb4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.664447 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab858c4a-4d36-4a27-9c16-72dd1ef1fb4a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:57.672457 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 56/118] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:51:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:57.673268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab858c4a-4d36-4a27-9c16-72dd1ef1fb4a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.685368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08832f-aa32-4295-bebc-6a2f5625f757 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.718505 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042648c-dfa6-4978-849a-3a05c57d4380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.719177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042648c-dfa6-4978-849a-3a05c57d4380 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042648c-dfa6-4978-849a-3a05c57d4380 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.719746 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042648c-dfa6-4978-849a-3a05c57d4380 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.720457 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042648c-dfa6-4978-849a-3a05c57d4380 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.721991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042648c-dfa6-4978-849a-3a05c57d4380 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:57.732476 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:57.748698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 63/119] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:51:57 2022] POST /identity/v3/projects => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:57.754227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042648c-dfa6-4978-849a-3a05c57d4380 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.776502 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab858c4a-4d36-4a27-9c16-72dd1ef1fb4a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.814024 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627374dd-fb71-4f73-ab70-6565be877f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.814984 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627374dd-fb71-4f73-ab70-6565be877f36 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.815263 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627374dd-fb71-4f73-ab70-6565be877f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.815538 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627374dd-fb71-4f73-ab70-6565be877f36 None admin] PATH_INFO: `/v3/users/dbbb04324a8649df81c9f75c69605aae` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.816874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627374dd-fb71-4f73-ab70-6565be877f36 None admin] RBAC: Authorizing `identity:get_user(user_id=dbbb04324a8649df81c9f75c69605aae)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.818450 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627374dd-fb71-4f73-ab70-6565be877f36 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:57.820197 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 57/120] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:57 2022] GET /identity/v3/users/dbbb04324a8649df81c9f75c69605aae => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:57.825416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627374dd-fb71-4f73-ab70-6565be877f36 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.870226 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:57.881396 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042648c-dfa6-4978-849a-3a05c57d4380 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.922857 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61a8d5-f674-4e49-aed6-ae95ff8ff8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.923243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61a8d5-f674-4e49-aed6-ae95ff8ff8e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.923535 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61a8d5-f674-4e49-aed6-ae95ff8ff8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.923815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61a8d5-f674-4e49-aed6-ae95ff8ff8e5 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6/users/21b09299f25d4591a38f3b193aad3d4d/roles/2099e2212de24144b089730e7db8ed3a` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.925906 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61a8d5-f674-4e49-aed6-ae95ff8ff8e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a8d6d084fc142bf96584a8573fbabd6, user_id=21b09299f25d4591a38f3b193aad3d4d, role_id=2099e2212de24144b089730e7db8ed3a)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.927380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61a8d5-f674-4e49-aed6-ae95ff8ff8e5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:57.940652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627374dd-fb71-4f73-ab70-6565be877f36 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.943637 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 64/121] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:51:57 2022] PUT /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6/users/21b09299f25d4591a38f3b193aad3d4d/roles/2099e2212de24144b089730e7db8ed3a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:51:57.945057 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c048ed-1518-48d5-8674-a19ff2a2a71a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.945531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c048ed-1518-48d5-8674-a19ff2a2a71a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.945977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c048ed-1518-48d5-8674-a19ff2a2a71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.969278 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-98c048ed-1518-48d5-8674-a19ff2a2a71a None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:57.971922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-98c048ed-1518-48d5-8674-a19ff2a2a71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:57.993764 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d5101-62fd-4f00-8e5e-633acae241bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.995094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d5101-62fd-4f00-8e5e-633acae241bb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.995621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d5101-62fd-4f00-8e5e-633acae241bb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.996321 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d5101-62fd-4f00-8e5e-633acae241bb None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d5101-62fd-4f00-8e5e-633acae241bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:57.998258 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d5101-62fd-4f00-8e5e-633acae241bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.999919 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d5101-62fd-4f00-8e5e-633acae241bb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:58.014102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 58/122] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:51:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:58.015394 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d5101-62fd-4f00-8e5e-633acae241bb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.040471 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:58.064417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 65/123] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:58.069607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c048ed-1518-48d5-8674-a19ff2a2a71a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.148239 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:58.152178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d5101-62fd-4f00-8e5e-633acae241bb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:58.192963 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2f499-7fe7-45a5-bacb-51f35d7531a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:58.194123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2f499-7fe7-45a5-bacb-51f35d7531a5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.194257 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c048ed-1518-48d5-8674-a19ff2a2a71a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:58.194681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2f499-7fe7-45a5-bacb-51f35d7531a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.195094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2f499-7fe7-45a5-bacb-51f35d7531a5 None admin] PATH_INFO: `/v3/users/064f0dae4c8842db95fcdcfd46ccec8c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.209017 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2f499-7fe7-45a5-bacb-51f35d7531a5 None admin] RBAC: Authorizing `identity:get_user(user_id=064f0dae4c8842db95fcdcfd46ccec8c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:58.210887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2f499-7fe7-45a5-bacb-51f35d7531a5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:58.213173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 59/124] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/users/064f0dae4c8842db95fcdcfd46ccec8c => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:58.214203 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2f499-7fe7-45a5-bacb-51f35d7531a5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.230131 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe45bc-259a-44a5-bf98-4bb77c4640c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:58.231049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe45bc-259a-44a5-bf98-4bb77c4640c9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.231357 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe45bc-259a-44a5-bf98-4bb77c4640c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.231645 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe45bc-259a-44a5-bf98-4bb77c4640c9 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.232884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe45bc-259a-44a5-bf98-4bb77c4640c9 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:58.234451 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe45bc-259a-44a5-bf98-4bb77c4640c9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:58.236263 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 66/125] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:58.241144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe45bc-259a-44a5-bf98-4bb77c4640c9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.295674 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:58.349895 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2f499-7fe7-45a5-bacb-51f35d7531a5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:58.355169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe45bc-259a-44a5-bf98-4bb77c4640c9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:58.386810 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806c456-5d22-416b-a261-fa5b5e7f65e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:58.388045 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806c456-5d22-416b-a261-fa5b5e7f65e6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.388577 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806c456-5d22-416b-a261-fa5b5e7f65e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.388864 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806c456-5d22-416b-a261-fa5b5e7f65e6 None admin] PATH_INFO: `/v3/users/21b09299f25d4591a38f3b193aad3d4d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.390803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806c456-5d22-416b-a261-fa5b5e7f65e6 None admin] RBAC: Authorizing `identity:get_user(user_id=21b09299f25d4591a38f3b193aad3d4d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:58.392933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806c456-5d22-416b-a261-fa5b5e7f65e6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:58.395279 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 60/126] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/users/21b09299f25d4591a38f3b193aad3d4d => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:58.396141 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806c456-5d22-416b-a261-fa5b5e7f65e6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.397510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0ec47-6b4f-4a6e-87a5-c5123d78f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:58.399208 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0ec47-6b4f-4a6e-87a5-c5123d78f918 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.400539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0ec47-6b4f-4a6e-87a5-c5123d78f918 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.400971 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0ec47-6b4f-4a6e-87a5-c5123d78f918 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.415623 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0ec47-6b4f-4a6e-87a5-c5123d78f918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-40f0ec47-6b4f-4a6e-87a5-c5123d78f918 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:58.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:58.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:58.428474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:58.428474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:58.428474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:58.428474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:58.428474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:58.428474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:58.428474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:58.428474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:58.428474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:58.428474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:58.428474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:58.428474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:51:58.429684 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:58.430997 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 67/127] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:58.433180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0ec47-6b4f-4a6e-87a5-c5123d78f918 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.518309 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806c456-5d22-416b-a261-fa5b5e7f65e6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:58.540525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0ec47-6b4f-4a6e-87a5-c5123d78f918 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:58.561120 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7da33-eaa6-4766-9fb7-3d53e89bea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:58.562225 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7da33-eaa6-4766-9fb7-3d53e89bea25 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.562527 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7da33-eaa6-4766-9fb7-3d53e89bea25 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.562813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7da33-eaa6-4766-9fb7-3d53e89bea25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.577629 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:58.587171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71b4aa-8aa2-4cbc-827f-f56e027fe623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:58.588468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71b4aa-8aa2-4cbc-827f-f56e027fe623 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.588760 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71b4aa-8aa2-4cbc-827f-f56e027fe623 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.589040 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71b4aa-8aa2-4cbc-827f-f56e027fe623 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6/users/dbbb04324a8649df81c9f75c69605aae/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.591413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71b4aa-8aa2-4cbc-827f-f56e027fe623 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a8d6d084fc142bf96584a8573fbabd6, user_id=dbbb04324a8649df81c9f75c69605aae, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:58.592581 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71b4aa-8aa2-4cbc-827f-f56e027fe623 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:58.611450 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 68/128] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:51:58 2022] PUT /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6/users/dbbb04324a8649df81c9f75c69605aae/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:51:58.612553 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71b4aa-8aa2-4cbc-827f-f56e027fe623 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.653634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7da33-eaa6-4766-9fb7-3d53e89bea25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:58.655509 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7da33-eaa6-4766-9fb7-3d53e89bea25 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:58.687619 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:58.748334 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71b4aa-8aa2-4cbc-827f-f56e027fe623 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:58.792607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8ed45-4bb7-4919-9d70-446416a31763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:58.793628 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8ed45-4bb7-4919-9d70-446416a31763 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.793923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8ed45-4bb7-4919-9d70-446416a31763 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.794206 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8ed45-4bb7-4919-9d70-446416a31763 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.795768 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8ed45-4bb7-4919-9d70-446416a31763 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:58.797307 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8ed45-4bb7-4919-9d70-446416a31763 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:58.799082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 69/129] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:58.799924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8ed45-4bb7-4919-9d70-446416a31763 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.848004 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:58.862484 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 61/130] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:51:58.863305 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7da33-eaa6-4766-9fb7-3d53e89bea25 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.924249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8ed45-4bb7-4919-9d70-446416a31763 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:58.960324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ae761-ea51-4cd3-9ee4-f56a579ff02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:58.961341 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ae761-ea51-4cd3-9ee4-f56a579ff02e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.961832 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ae761-ea51-4cd3-9ee4-f56a579ff02e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.962290 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ae761-ea51-4cd3-9ee4-f56a579ff02e None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.963592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ae761-ea51-4cd3-9ee4-f56a579ff02e None admin] RBAC: Adding query filter params (name=member) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:58.964077 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ae761-ea51-4cd3-9ee4-f56a579ff02e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:58.965679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ae761-ea51-4cd3-9ee4-f56a579ff02e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:58.974651 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 70/131] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:58.975700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ae761-ea51-4cd3-9ee4-f56a579ff02e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.976188 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7da33-eaa6-4766-9fb7-3d53e89bea25 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:59.004483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:59.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a42eb-5fbf-462f-ba6e-b72baea92ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:59.014191 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a42eb-5fbf-462f-ba6e-b72baea92ad7 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.014532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a42eb-5fbf-462f-ba6e-b72baea92ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.015049 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a42eb-5fbf-462f-ba6e-b72baea92ad7 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6/users/21b09299f25d4591a38f3b193aad3d4d/roles/d91e55b589bd4b9aaab2ab607f087f8d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.017751 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a42eb-5fbf-462f-ba6e-b72baea92ad7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a8d6d084fc142bf96584a8573fbabd6, user_id=21b09299f25d4591a38f3b193aad3d4d, role_id=d91e55b589bd4b9aaab2ab607f087f8d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:59.019381 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a42eb-5fbf-462f-ba6e-b72baea92ad7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:59.038353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 62/132] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:51:58 2022] PUT /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6/users/21b09299f25d4591a38f3b193aad3d4d/roles/d91e55b589bd4b9aaab2ab607f087f8d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:51:59.039477 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a42eb-5fbf-462f-ba6e-b72baea92ad7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:59.098886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:59.103379 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ae761-ea51-4cd3-9ee4-f56a579ff02e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:59.148093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ef4a3-bd41-4e80-8851-a5f5064dae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:59.149482 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ef4a3-bd41-4e80-8851-a5f5064dae2b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.149899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ef4a3-bd41-4e80-8851-a5f5064dae2b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.150296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ef4a3-bd41-4e80-8851-a5f5064dae2b None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.151626 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ef4a3-bd41-4e80-8851-a5f5064dae2b None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:59.153630 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ef4a3-bd41-4e80-8851-a5f5064dae2b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:59.156436 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 71/133] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:59.162909 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ef4a3-bd41-4e80-8851-a5f5064dae2b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:59.273085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a42eb-5fbf-462f-ba6e-b72baea92ad7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:59.307404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ef4a3-bd41-4e80-8851-a5f5064dae2b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:59.346218 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d31d7-43b1-466b-ac0e-4300026a8661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:59.347661 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d31d7-43b1-466b-ac0e-4300026a8661 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.349313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d31d7-43b1-466b-ac0e-4300026a8661 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.349908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d31d7-43b1-466b-ac0e-4300026a8661 None admin] PATH_INFO: `/v3/users/21b09299f25d4591a38f3b193aad3d4d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.352830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d31d7-43b1-466b-ac0e-4300026a8661 None admin] RBAC: Authorizing `identity:get_user(user_id=21b09299f25d4591a38f3b193aad3d4d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:59.355856 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d31d7-43b1-466b-ac0e-4300026a8661 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:59.358941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 63/134] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:59 2022] GET /identity/v3/users/21b09299f25d4591a38f3b193aad3d4d => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:59.364826 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d31d7-43b1-466b-ac0e-4300026a8661 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:59.378060 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626b51c-52b4-44ea-b2d2-5fe6998721a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:59.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626b51c-52b4-44ea-b2d2-5fe6998721a5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.379441 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626b51c-52b4-44ea-b2d2-5fe6998721a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.379880 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626b51c-52b4-44ea-b2d2-5fe6998721a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.380881 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626b51c-52b4-44ea-b2d2-5fe6998721a5 None admin] RBAC: Adding query filter params (role.id=56edef813db54c3c826f9af018142f20, scope.project.id=4a8d6d084fc142bf96584a8573fbabd6, user.id=064f0dae4c8842db95fcdcfd46ccec8c) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:59.382679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626b51c-52b4-44ea-b2d2-5fe6998721a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:59.384345 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626b51c-52b4-44ea-b2d2-5fe6998721a5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:59.396057 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 72/135] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:51:59 2022] GET /identity/v3/role_assignments?user.id=064f0dae4c8842db95fcdcfd46ccec8c&scope.project.id=4a8d6d084fc142bf96584a8573fbabd6&role.id=56edef813db54c3c826f9af018142f20 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:59.447578 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:59.496354 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d31d7-43b1-466b-ac0e-4300026a8661 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:59.542314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c43f0e-7e64-47c0-96e7-ee4cca2412cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:59.543436 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c43f0e-7e64-47c0-96e7-ee4cca2412cf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.543861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c43f0e-7e64-47c0-96e7-ee4cca2412cf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.544291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c43f0e-7e64-47c0-96e7-ee4cca2412cf None admin] PATH_INFO: `/v3/projects/ac7846253ff8494cb07a57b9fef377e7` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.545848 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c43f0e-7e64-47c0-96e7-ee4cca2412cf None admin] RBAC: Authorizing `identity:get_project(project_id=ac7846253ff8494cb07a57b9fef377e7)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:59.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c43f0e-7e64-47c0-96e7-ee4cca2412cf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:59.549477 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 64/136] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:59 2022] GET /identity/v3/projects/ac7846253ff8494cb07a57b9fef377e7 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:59.555601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626b51c-52b4-44ea-b2d2-5fe6998721a5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:59.600719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:59.671945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626b51c-52b4-44ea-b2d2-5fe6998721a5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:59.706871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192b7f0-5b28-4625-b7f2-e200e3e8d5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:59.707813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192b7f0-5b28-4625-b7f2-e200e3e8d5ea None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.708090 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192b7f0-5b28-4625-b7f2-e200e3e8d5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.708376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192b7f0-5b28-4625-b7f2-e200e3e8d5ea None admin] PATH_INFO: `/v3/projects/ac7846253ff8494cb07a57b9fef377e7/users/21b09299f25d4591a38f3b193aad3d4d/roles/2099e2212de24144b089730e7db8ed3a` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.710389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192b7f0-5b28-4625-b7f2-e200e3e8d5ea None admin] RBAC: Authorizing `identity:create_grant(project_id=ac7846253ff8494cb07a57b9fef377e7, user_id=21b09299f25d4591a38f3b193aad3d4d, role_id=2099e2212de24144b089730e7db8ed3a)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:59.711861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192b7f0-5b28-4625-b7f2-e200e3e8d5ea None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:59.729617 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 73/137] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:51:59 2022] PUT /identity/v3/projects/ac7846253ff8494cb07a57b9fef377e7/users/21b09299f25d4591a38f3b193aad3d4d/roles/2099e2212de24144b089730e7db8ed3a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:00.648062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac431d-3fe7-48e7-b3c0-8c90b340361f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:00.648638 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac431d-3fe7-48e7-b3c0-8c90b340361f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:00.648862 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac431d-3fe7-48e7-b3c0-8c90b340361f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:00.650699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 65/138] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:00.667121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f124e-2848-4323-ad94-88e800d0c4d5 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:00.667408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f124e-2848-4323-ad94-88e800d0c4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:00.667694 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f124e-2848-4323-ad94-88e800d0c4d5 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:00.669310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 66/139] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:00.670720 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084acfb-435d-4bf1-8485-8669dd3fe2b9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:00.671154 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084acfb-435d-4bf1-8485-8669dd3fe2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:00.671327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084acfb-435d-4bf1-8485-8669dd3fe2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:00.673744 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce40e45-c957-49d0-ab9c-f8b721546f3b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:00.674031 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce40e45-c957-49d0-ab9c-f8b721546f3b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:00.674340 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce40e45-c957-49d0-ab9c-f8b721546f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:00.708990 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5ce40e45-c957-49d0-ab9c-f8b721546f3b None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:00.710246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5ce40e45-c957-49d0-ab9c-f8b721546f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:00.713495 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0084acfb-435d-4bf1-8485-8669dd3fe2b9 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:00.714661 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0084acfb-435d-4bf1-8485-8669dd3fe2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:00.864446 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 67/140] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:00.866543 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 74/141] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:00.906132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce40e45-c957-49d0-ab9c-f8b721546f3b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:00.907027 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084acfb-435d-4bf1-8485-8669dd3fe2b9 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:00.944354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:01.013355 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:01.097583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084acfb-435d-4bf1-8485-8669dd3fe2b9 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:01.100738 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce40e45-c957-49d0-ab9c-f8b721546f3b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:01.147282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f3e43-6327-4773-9df2-68ca3f69a45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:01.148026 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f3e43-6327-4773-9df2-68ca3f69a45c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.148310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f3e43-6327-4773-9df2-68ca3f69a45c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.148588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f3e43-6327-4773-9df2-68ca3f69a45c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.151673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8417916-21ad-43f5-af82-f2164030fc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:01.152613 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417916-21ad-43f5-af82-f2164030fc44 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.152998 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417916-21ad-43f5-af82-f2164030fc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.153402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8417916-21ad-43f5-af82-f2164030fc44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.154721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8417916-21ad-43f5-af82-f2164030fc44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:01.156259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8417916-21ad-43f5-af82-f2164030fc44 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:01.158030 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 75/142] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:01.160440 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f3e43-6327-4773-9df2-68ca3f69a45c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:01.163707 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8417916-21ad-43f5-af82-f2164030fc44 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-2a5f3e43-6327-4773-9df2-68ca3f69a45c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:01.171585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:01.172741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:01.173775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:01.173775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:01.173775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:01.173775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:01.173775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:01.173775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:01.173775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:01.173775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:01.173775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:01.173775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:01.173775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:01.173775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:01.175296 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 68/143] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:01.182504 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f3e43-6327-4773-9df2-68ca3f69a45c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:01.319919 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:01.329461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8417916-21ad-43f5-af82-f2164030fc44 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:01.369266 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741f1dc-fc0f-4f5b-aa57-77768ba731c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:01.369958 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741f1dc-fc0f-4f5b-aa57-77768ba731c7 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.370237 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741f1dc-fc0f-4f5b-aa57-77768ba731c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.370510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741f1dc-fc0f-4f5b-aa57-77768ba731c7 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.371257 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741f1dc-fc0f-4f5b-aa57-77768ba731c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:01.375682 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741f1dc-fc0f-4f5b-aa57-77768ba731c7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:01.390483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f3e43-6327-4773-9df2-68ca3f69a45c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:01.405656 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 76/144] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:01 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:52:01.412361 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:01.433792 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cac2b-1e66-4d6a-88ad-9ca17913d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:01.434496 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cac2b-1e66-4d6a-88ad-9ca17913d130 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.434788 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cac2b-1e66-4d6a-88ad-9ca17913d130 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.435075 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cac2b-1e66-4d6a-88ad-9ca17913d130 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.435861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cac2b-1e66-4d6a-88ad-9ca17913d130 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:01.436172 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cac2b-1e66-4d6a-88ad-9ca17913d130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:01.437660 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cac2b-1e66-4d6a-88ad-9ca17913d130 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:01.447641 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 69/145] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:01.453328 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741f1dc-fc0f-4f5b-aa57-77768ba731c7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:01.465325 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba63981-d087-4de3-a82d-ac95be3b820b None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.465679 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba63981-d087-4de3-a82d-ac95be3b820b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.465890 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba63981-d087-4de3-a82d-ac95be3b820b None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.467420 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 70/146] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:01.473665 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054f2d9-4d48-4cbb-bdcf-cecf3b5da684 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.473936 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054f2d9-4d48-4cbb-bdcf-cecf3b5da684 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.474213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054f2d9-4d48-4cbb-bdcf-cecf3b5da684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.506721 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d054f2d9-4d48-4cbb-bdcf-cecf3b5da684 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:01.507956 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d054f2d9-4d48-4cbb-bdcf-cecf3b5da684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:01.632974 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 71/147] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:01.643727 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741f1dc-fc0f-4f5b-aa57-77768ba731c7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:01.658849 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054f2d9-4d48-4cbb-bdcf-cecf3b5da684 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:01.690234 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d908c-a59f-4d02-a806-cae4d1c02513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:01.691157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d908c-a59f-4d02-a806-cae4d1c02513 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.691435 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d908c-a59f-4d02-a806-cae4d1c02513 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.691703 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d908c-a59f-4d02-a806-cae4d1c02513 None admin] PATH_INFO: `/v3/users/21b09299f25d4591a38f3b193aad3d4d` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.693998 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d908c-a59f-4d02-a806-cae4d1c02513 None admin] RBAC: Authorizing `identity:get_user(user_id=21b09299f25d4591a38f3b193aad3d4d)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:01.695778 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d908c-a59f-4d02-a806-cae4d1c02513 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:01.698342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 77/148] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:01 2022] GET /identity/v3/users/21b09299f25d4591a38f3b193aad3d4d => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:01.706517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d908c-a59f-4d02-a806-cae4d1c02513 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:01.737981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:01.829027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054f2d9-4d48-4cbb-bdcf-cecf3b5da684 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:01.833279 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:01.886163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d908c-a59f-4d02-a806-cae4d1c02513 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:01.897560 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464da66-9abc-4e7f-a743-60572bab5f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:01.898395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464da66-9abc-4e7f-a743-60572bab5f8b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.898670 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464da66-9abc-4e7f-a743-60572bab5f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.898941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464da66-9abc-4e7f-a743-60572bab5f8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.926347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464da66-9abc-4e7f-a743-60572bab5f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f464da66-9abc-4e7f-a743-60572bab5f8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:01.934066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:01.934954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:01.935748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 72/149] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:01.942753 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464da66-9abc-4e7f-a743-60572bab5f8b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:01.955391 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350b262-f7fd-49ad-b912-964f0861e869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:01.956424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350b262-f7fd-49ad-b912-964f0861e869 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.956721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350b262-f7fd-49ad-b912-964f0861e869 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.957141 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350b262-f7fd-49ad-b912-964f0861e869 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.061236 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350b262-f7fd-49ad-b912-964f0861e869 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:02.062741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350b262-f7fd-49ad-b912-964f0861e869 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:02.070760 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464da66-9abc-4e7f-a743-60572bab5f8b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:02.079552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:02.120628 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6112ce-278e-421c-87a9-02b9791dc604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:02.121971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6112ce-278e-421c-87a9-02b9791dc604 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.122260 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6112ce-278e-421c-87a9-02b9791dc604 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.122527 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6112ce-278e-421c-87a9-02b9791dc604 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.123290 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6112ce-278e-421c-87a9-02b9791dc604 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:02.123596 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6112ce-278e-421c-87a9-02b9791dc604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:02.125000 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6112ce-278e-421c-87a9-02b9791dc604 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:02.137475 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 73/150] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:02.138896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee68a7b-9aee-4400-90d6-4099afddd69e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.139175 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee68a7b-9aee-4400-90d6-4099afddd69e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.139456 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee68a7b-9aee-4400-90d6-4099afddd69e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.140724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 74/151] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:02.144651 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee68a7b-9aee-4400-90d6-4099afddd69e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:02.183115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:02.192386 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 78/152] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:52:02.195383 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07c43f-9ba7-4cc9-9226-db1153611117 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.195921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07c43f-9ba7-4cc9-9226-db1153611117 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.196393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07c43f-9ba7-4cc9-9226-db1153611117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.216439 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-8e07c43f-9ba7-4cc9-9226-db1153611117 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:02.218058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8e07c43f-9ba7-4cc9-9226-db1153611117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:02.298668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 79/153] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:02.300031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07c43f-9ba7-4cc9-9226-db1153611117 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:02.365723 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:02.381895 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee68a7b-9aee-4400-90d6-4099afddd69e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:02.430357 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07c43f-9ba7-4cc9-9226-db1153611117 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:02.471760 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bf347-4f13-440a-8693-af4820e1569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:02.472993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bf347-4f13-440a-8693-af4820e1569d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.473505 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bf347-4f13-440a-8693-af4820e1569d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.473988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bf347-4f13-440a-8693-af4820e1569d None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.475390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bf347-4f13-440a-8693-af4820e1569d None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:02.477075 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bf347-4f13-440a-8693-af4820e1569d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:02.479370 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 80/154] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:02 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:02.480418 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bf347-4f13-440a-8693-af4820e1569d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:02.481572 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de22774-6ce0-4343-ba28-e2449a1c3d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:02.482482 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de22774-6ce0-4343-ba28-e2449a1c3d58 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.482758 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de22774-6ce0-4343-ba28-e2449a1c3d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.483029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de22774-6ce0-4343-ba28-e2449a1c3d58 None admin] PATH_INFO: `/v3/users/dbbb04324a8649df81c9f75c69605aae` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.488097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de22774-6ce0-4343-ba28-e2449a1c3d58 None admin] RBAC: Authorizing `identity:get_user(user_id=dbbb04324a8649df81c9f75c69605aae)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:02.489607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de22774-6ce0-4343-ba28-e2449a1c3d58 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:02.491344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 75/155] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:02 2022] GET /identity/v3/users/dbbb04324a8649df81c9f75c69605aae => generated 247 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:02.492094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de22774-6ce0-4343-ba28-e2449a1c3d58 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:02.604602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bf347-4f13-440a-8693-af4820e1569d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:02.626369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:02.627071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:02.636784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de22774-6ce0-4343-ba28-e2449a1c3d58 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:02.653683 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990140a-ccfd-4964-9251-fdac67d467ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:02.654912 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990140a-ccfd-4964-9251-fdac67d467ee None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.655289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990140a-ccfd-4964-9251-fdac67d467ee None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.655571 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990140a-ccfd-4964-9251-fdac67d467ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.668969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990140a-ccfd-4964-9251-fdac67d467ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-8990140a-ccfd-4964-9251-fdac67d467ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:02.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:02.678458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:02.679315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 81/156] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:02.679970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990140a-ccfd-4964-9251-fdac67d467ee None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:02.682024 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d783e60-755b-45fa-946f-7b44bc4bc666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:02.682931 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d783e60-755b-45fa-946f-7b44bc4bc666 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.683222 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d783e60-755b-45fa-946f-7b44bc4bc666 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.683497 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d783e60-755b-45fa-946f-7b44bc4bc666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.685303 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d783e60-755b-45fa-946f-7b44bc4bc666 None admin] RBAC: Adding query filter params (role.id=2099e2212de24144b089730e7db8ed3a, scope.project.id=4a8d6d084fc142bf96584a8573fbabd6, user.id=21b09299f25d4591a38f3b193aad3d4d) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:02.685626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d783e60-755b-45fa-946f-7b44bc4bc666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:02.687183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d783e60-755b-45fa-946f-7b44bc4bc666 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:02.697835 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 76/157] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:02 2022] GET /identity/v3/role_assignments?user.id=21b09299f25d4591a38f3b193aad3d4d&scope.project.id=4a8d6d084fc142bf96584a8573fbabd6&role.id=2099e2212de24144b089730e7db8ed3a => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:02.699202 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe7c2c-67eb-4938-b7e1-cdeb5188dc15 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.699485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe7c2c-67eb-4938-b7e1-cdeb5188dc15 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.699761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe7c2c-67eb-4938-b7e1-cdeb5188dc15 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.701387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 77/158] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:02.702119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe7c2c-67eb-4938-b7e1-cdeb5188dc15 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:02.865654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990140a-ccfd-4964-9251-fdac67d467ee None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:02.949416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe7c2c-67eb-4938-b7e1-cdeb5188dc15 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:02.961732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de266b-8c37-417d-aba7-93aef2ccf1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:02.963180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de266b-8c37-417d-aba7-93aef2ccf1aa None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.963658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de266b-8c37-417d-aba7-93aef2ccf1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.964131 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de266b-8c37-417d-aba7-93aef2ccf1aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.994902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ced494-49a3-404d-a263-81ba5d82e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:02.995593 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ced494-49a3-404d-a263-81ba5d82e91a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.997168 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ced494-49a3-404d-a263-81ba5d82e91a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.997468 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ced494-49a3-404d-a263-81ba5d82e91a None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.998248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ced494-49a3-404d-a263-81ba5d82e91a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:02.998554 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ced494-49a3-404d-a263-81ba5d82e91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:02.999968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ced494-49a3-404d-a263-81ba5d82e91a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:03.020646 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 78/159] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:03.021811 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997073fc-1d57-449e-ae1e-f0bc5c834794 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.026812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997073fc-1d57-449e-ae1e-f0bc5c834794 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.027101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997073fc-1d57-449e-ae1e-f0bc5c834794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.043415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.053807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-997073fc-1d57-449e-ae1e-f0bc5c834794 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:03.055373 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-997073fc-1d57-449e-ae1e-f0bc5c834794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:03.079877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.083834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de266b-8c37-417d-aba7-93aef2ccf1aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:03.085837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de266b-8c37-417d-aba7-93aef2ccf1aa None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:03.186741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 79/160] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:03.187932 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997073fc-1d57-449e-ae1e-f0bc5c834794 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.200939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 82/161] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:03.202341 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9f85d-a4ae-42bc-b0b1-c434c2427217 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.202628 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9f85d-a4ae-42bc-b0b1-c434c2427217 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.202901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9f85d-a4ae-42bc-b0b1-c434c2427217 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.204669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 83/162] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:03.212499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9f85d-a4ae-42bc-b0b1-c434c2427217 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.306609 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.312369 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997073fc-1d57-449e-ae1e-f0bc5c834794 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:03.355889 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9f85d-a4ae-42bc-b0b1-c434c2427217 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:03.356396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbab955-4b88-431e-893a-6d308e9fdd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:03.357607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab955-4b88-431e-893a-6d308e9fdd4b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.358058 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab955-4b88-431e-893a-6d308e9fdd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.358545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab955-4b88-431e-893a-6d308e9fdd4b None admin] PATH_INFO: `/v3/users/21b09299f25d4591a38f3b193aad3d4d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.359940 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbab955-4b88-431e-893a-6d308e9fdd4b None admin] RBAC: Authorizing `identity:get_user(user_id=21b09299f25d4591a38f3b193aad3d4d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:03.361705 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbab955-4b88-431e-893a-6d308e9fdd4b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:03.363639 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 80/163] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/users/21b09299f25d4591a38f3b193aad3d4d => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:03.364988 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2bd39-8f7f-4a2b-98ba-e98861f70c21 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.365468 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2bd39-8f7f-4a2b-98ba-e98861f70c21 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.365918 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2bd39-8f7f-4a2b-98ba-e98861f70c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.383872 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-45e2bd39-8f7f-4a2b-98ba-e98861f70c21 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:03.385443 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-45e2bd39-8f7f-4a2b-98ba-e98861f70c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:03.400241 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.408759 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b120f4-97b8-4a40-9698-066f0da4d072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:03.409703 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b120f4-97b8-4a40-9698-066f0da4d072 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.409985 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b120f4-97b8-4a40-9698-066f0da4d072 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.410298 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b120f4-97b8-4a40-9698-066f0da4d072 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.411995 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b120f4-97b8-4a40-9698-066f0da4d072 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:03.413823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b120f4-97b8-4a40-9698-066f0da4d072 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:03.415901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 84/164] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:03.421445 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b120f4-97b8-4a40-9698-066f0da4d072 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.464704 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 81/165] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:03.467884 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2bd39-8f7f-4a2b-98ba-e98861f70c21 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.619961 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2bd39-8f7f-4a2b-98ba-e98861f70c21 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:03.635375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b120f4-97b8-4a40-9698-066f0da4d072 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:03.656160 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5e8c4-5f80-46ae-b855-aaaa2e4fcb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:03.657219 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5e8c4-5f80-46ae-b855-aaaa2e4fcb53 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.657677 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5e8c4-5f80-46ae-b855-aaaa2e4fcb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.658122 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5e8c4-5f80-46ae-b855-aaaa2e4fcb53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.677826 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.730090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5e8c4-5f80-46ae-b855-aaaa2e4fcb53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:03.730696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7098f7-5d34-4acb-a056-19fb86de250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:03.731280 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7098f7-5d34-4acb-a056-19fb86de250a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.731565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7098f7-5d34-4acb-a056-19fb86de250a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.731839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7098f7-5d34-4acb-a056-19fb86de250a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.733135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5e8c4-5f80-46ae-b855-aaaa2e4fcb53 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:03.762180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.770906 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7098f7-5d34-4acb-a056-19fb86de250a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-ab7098f7-5d34-4acb-a056-19fb86de250a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:03.778619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:03.779511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:03.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:03.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:03.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:03.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:03.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:03.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:03.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:03.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:03.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:03.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:03.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:03.780537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:03.789685 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 85/166] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:03.790576 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7098f7-5d34-4acb-a056-19fb86de250a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.836990 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 82/167] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:03.838485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5e8c4-5f80-46ae-b855-aaaa2e4fcb53 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.935785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.960001 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7098f7-5d34-4acb-a056-19fb86de250a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.008257 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5e8c4-5f80-46ae-b855-aaaa2e4fcb53 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.039262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4661f3d-52b3-4b87-9591-7e0947237a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.040358 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4661f3d-52b3-4b87-9591-7e0947237a27 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.040838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4661f3d-52b3-4b87-9591-7e0947237a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.041336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4661f3d-52b3-4b87-9591-7e0947237a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.042384 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4661f3d-52b3-4b87-9591-7e0947237a27 None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=4a8d6d084fc142bf96584a8573fbabd6, user.id=dbbb04324a8649df81c9f75c69605aae) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:04.042924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4661f3d-52b3-4b87-9591-7e0947237a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.044597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4661f3d-52b3-4b87-9591-7e0947237a27 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.051536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af280075-d7e3-42fc-9cd2-a8991b995f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.051853 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 86/168] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/role_assignments?user.id=dbbb04324a8649df81c9f75c69605aae&scope.project.id=4a8d6d084fc142bf96584a8573fbabd6&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.052217 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af280075-d7e3-42fc-9cd2-a8991b995f46 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.052500 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af280075-d7e3-42fc-9cd2-a8991b995f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.052772 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af280075-d7e3-42fc-9cd2-a8991b995f46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.053536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4661f3d-52b3-4b87-9591-7e0947237a27 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.075212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af280075-d7e3-42fc-9cd2-a8991b995f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-af280075-d7e3-42fc-9cd2-a8991b995f46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:04.091839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:04.092823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:04.093634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 83/169] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:04.106304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af280075-d7e3-42fc-9cd2-a8991b995f46 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.131317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:04.172813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4661f3d-52b3-4b87-9591-7e0947237a27 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.246092 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc60f2-7a96-4827-a082-accead50a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.246807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc60f2-7a96-4827-a082-accead50a55c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.247097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc60f2-7a96-4827-a082-accead50a55c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.247378 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc60f2-7a96-4827-a082-accead50a55c None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.248164 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc60f2-7a96-4827-a082-accead50a55c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:04.248476 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc60f2-7a96-4827-a082-accead50a55c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.249946 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc60f2-7a96-4827-a082-accead50a55c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.264878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 87/170] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.265562 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc60f2-7a96-4827-a082-accead50a55c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.308490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af280075-d7e3-42fc-9cd2-a8991b995f46 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.329597 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:04.345218 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae30d6-713a-4bf5-9960-73271c3e7f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.346131 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae30d6-713a-4bf5-9960-73271c3e7f46 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.346517 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae30d6-713a-4bf5-9960-73271c3e7f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.346799 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae30d6-713a-4bf5-9960-73271c3e7f46 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.348136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae30d6-713a-4bf5-9960-73271c3e7f46 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.349994 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae30d6-713a-4bf5-9960-73271c3e7f46 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.352137 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 84/171] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.352932 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae30d6-713a-4bf5-9960-73271c3e7f46 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.457133 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae30d6-713a-4bf5-9960-73271c3e7f46 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.495267 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b19d8-b00c-4dde-868f-f3402b433ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.496262 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b19d8-b00c-4dde-868f-f3402b433ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.496550 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b19d8-b00c-4dde-868f-f3402b433ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.496825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b19d8-b00c-4dde-868f-f3402b433ca3 None admin] PATH_INFO: `/v3/users/064f0dae4c8842db95fcdcfd46ccec8c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.498131 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b19d8-b00c-4dde-868f-f3402b433ca3 None admin] RBAC: Authorizing `identity:get_user(user_id=064f0dae4c8842db95fcdcfd46ccec8c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.499570 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b19d8-b00c-4dde-868f-f3402b433ca3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.501366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 85/172] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/users/064f0dae4c8842db95fcdcfd46ccec8c => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.502213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b19d8-b00c-4dde-868f-f3402b433ca3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.539223 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc60f2-7a96-4827-a082-accead50a55c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.553580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:04.597503 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:04.617562 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b19d8-b00c-4dde-868f-f3402b433ca3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.621941 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da376ed6-e6c1-4819-bd2d-9f2c3a0390af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.622656 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da376ed6-e6c1-4819-bd2d-9f2c3a0390af None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.622945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da376ed6-e6c1-4819-bd2d-9f2c3a0390af None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.623276 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da376ed6-e6c1-4819-bd2d-9f2c3a0390af None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.624062 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da376ed6-e6c1-4819-bd2d-9f2c3a0390af None admin] RBAC: Adding query filter params (name=member) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:04.624373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da376ed6-e6c1-4819-bd2d-9f2c3a0390af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.625810 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da376ed6-e6c1-4819-bd2d-9f2c3a0390af None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.647182 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 88/173] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.648021 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da376ed6-e6c1-4819-bd2d-9f2c3a0390af None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.657190 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec115a6-f673-4c07-a556-605aac4abf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.658117 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec115a6-f673-4c07-a556-605aac4abf8b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.658541 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec115a6-f673-4c07-a556-605aac4abf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.658984 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec115a6-f673-4c07-a556-605aac4abf8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.659979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec115a6-f673-4c07-a556-605aac4abf8b None admin] RBAC: Adding query filter params (role.id=d91e55b589bd4b9aaab2ab607f087f8d, scope.project.id=4a8d6d084fc142bf96584a8573fbabd6, user.id=21b09299f25d4591a38f3b193aad3d4d) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:04.660537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec115a6-f673-4c07-a556-605aac4abf8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.662189 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec115a6-f673-4c07-a556-605aac4abf8b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.668849 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 86/174] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/role_assignments?user.id=21b09299f25d4591a38f3b193aad3d4d&scope.project.id=4a8d6d084fc142bf96584a8573fbabd6&role.id=d91e55b589bd4b9aaab2ab607f087f8d => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.671727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec115a6-f673-4c07-a556-605aac4abf8b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.818621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec115a6-f673-4c07-a556-605aac4abf8b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.829632 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:04.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da376ed6-e6c1-4819-bd2d-9f2c3a0390af None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.857333 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed7f13-8f6e-4729-ab62-994113a1acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.858447 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed7f13-8f6e-4729-ab62-994113a1acfd None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.858908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed7f13-8f6e-4729-ab62-994113a1acfd None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.861881 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed7f13-8f6e-4729-ab62-994113a1acfd None admin] PATH_INFO: `/v3/users/21b09299f25d4591a38f3b193aad3d4d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.861881 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed7f13-8f6e-4729-ab62-994113a1acfd None admin] RBAC: Authorizing `identity:get_user(user_id=21b09299f25d4591a38f3b193aad3d4d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.862681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed7f13-8f6e-4729-ab62-994113a1acfd None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.864651 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 87/175] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/users/21b09299f25d4591a38f3b193aad3d4d => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.866250 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73a30d-34a4-4e00-b3a0-964f36f85d8a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.866740 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73a30d-34a4-4e00-b3a0-964f36f85d8a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.867192 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73a30d-34a4-4e00-b3a0-964f36f85d8a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.868789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 88/176] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:04.874133 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2bce7-5d6f-4d38-82a2-e277aef20c6b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.874631 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2bce7-5d6f-4d38-82a2-e277aef20c6b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.875081 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2bce7-5d6f-4d38-82a2-e277aef20c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.893848 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a7b2bce7-5d6f-4d38-82a2-e277aef20c6b None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:04.895371 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a7b2bce7-5d6f-4d38-82a2-e277aef20c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:04.922061 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f8cbb-4a04-4ae1-85db-0c58eee78a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.922987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f8cbb-4a04-4ae1-85db-0c58eee78a41 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.923281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f8cbb-4a04-4ae1-85db-0c58eee78a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.923555 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f8cbb-4a04-4ae1-85db-0c58eee78a41 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.925108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f8cbb-4a04-4ae1-85db-0c58eee78a41 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.926570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f8cbb-4a04-4ae1-85db-0c58eee78a41 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.928303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 89/177] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.929077 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f8cbb-4a04-4ae1-85db-0c58eee78a41 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.972352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 89/178] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:04.973674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2bce7-5d6f-4d38-82a2-e277aef20c6b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.010362 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.054472 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f8cbb-4a04-4ae1-85db-0c58eee78a41 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.091902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50885b54-f1c1-4441-87bd-335b94f37c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.091902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50885b54-f1c1-4441-87bd-335b94f37c73 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.092174 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50885b54-f1c1-4441-87bd-335b94f37c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.092420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50885b54-f1c1-4441-87bd-335b94f37c73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.114030 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2bce7-5d6f-4d38-82a2-e277aef20c6b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.122692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.161877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed4c27-2a6f-4949-9901-24a7e6375bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.163139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed4c27-2a6f-4949-9901-24a7e6375bf4 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.163671 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed4c27-2a6f-4949-9901-24a7e6375bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.164158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed4c27-2a6f-4949-9901-24a7e6375bf4 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6/users/064f0dae4c8842db95fcdcfd46ccec8c/roles/56edef813db54c3c826f9af018142f20` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.168267 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed4c27-2a6f-4949-9901-24a7e6375bf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a8d6d084fc142bf96584a8573fbabd6, user_id=064f0dae4c8842db95fcdcfd46ccec8c, role_id=56edef813db54c3c826f9af018142f20)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.170083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed4c27-2a6f-4949-9901-24a7e6375bf4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.184629 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50885b54-f1c1-4441-87bd-335b94f37c73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.186349 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50885b54-f1c1-4441-87bd-335b94f37c73 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.192324 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 90/179] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:04 2022] PUT /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6/users/064f0dae4c8842db95fcdcfd46ccec8c/roles/56edef813db54c3c826f9af018142f20 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:05.194349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed4c27-2a6f-4949-9901-24a7e6375bf4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.273732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.315869 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 90/180] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:05.318673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50885b54-f1c1-4441-87bd-335b94f37c73 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.321173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed4c27-2a6f-4949-9901-24a7e6375bf4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.384440 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a99385-cf27-42ce-ac12-38ef3f21ae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.385775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a99385-cf27-42ce-ac12-38ef3f21ae41 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.386557 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a99385-cf27-42ce-ac12-38ef3f21ae41 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.387030 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a99385-cf27-42ce-ac12-38ef3f21ae41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.402238 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a99385-cf27-42ce-ac12-38ef3f21ae41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-00a99385-cf27-42ce-ac12-38ef3f21ae41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:05.413429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:05.414410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:05.415208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:05.415208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:05.415208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:05.415208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:05.415208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:05.415208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:05.415208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:05.415208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:05.415208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:05.415208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:05.415208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:05.415208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:05.418239 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 91/181] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:05.420052 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4286dcd-6729-4624-bb31-80b073e0d8c2 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.420572 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4286dcd-6729-4624-bb31-80b073e0d8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.421037 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4286dcd-6729-4624-bb31-80b073e0d8c2 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.423225 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 92/182] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:05.424648 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4286dcd-6729-4624-bb31-80b073e0d8c2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.442673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50885b54-f1c1-4441-87bd-335b94f37c73 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.461235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.485468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e757c64-4cc4-4c4f-86ec-89aebf107a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.486349 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757c64-4cc4-4c4f-86ec-89aebf107a6c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.486639 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757c64-4cc4-4c4f-86ec-89aebf107a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.486972 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757c64-4cc4-4c4f-86ec-89aebf107a6c None admin] PATH_INFO: `/v3/projects/ac7846253ff8494cb07a57b9fef377e7` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.488170 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e757c64-4cc4-4c4f-86ec-89aebf107a6c None admin] RBAC: Authorizing `identity:get_project(project_id=ac7846253ff8494cb07a57b9fef377e7)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.489669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e757c64-4cc4-4c4f-86ec-89aebf107a6c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.491409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 91/183] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/projects/ac7846253ff8494cb07a57b9fef377e7 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:05.494380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ad7d2-36c1-4bc3-af8c-d7dc76f41356 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.494380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ad7d2-36c1-4bc3-af8c-d7dc76f41356 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.494380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ad7d2-36c1-4bc3-af8c-d7dc76f41356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.509829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-af9ad7d2-36c1-4bc3-af8c-d7dc76f41356 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:05.511035 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-af9ad7d2-36c1-4bc3-af8c-d7dc76f41356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:05.528693 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.548560 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4286dcd-6729-4624-bb31-80b073e0d8c2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.584287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 92/184] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:05.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164f16-a84c-49cf-a527-5964b0e5ee0d None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.586017 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164f16-a84c-49cf-a527-5964b0e5ee0d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.586287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164f16-a84c-49cf-a527-5964b0e5ee0d None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.587679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 93/185] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:05.588939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c164f16-a84c-49cf-a527-5964b0e5ee0d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.591416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f258d7d-05b4-4af0-a99f-59c56428012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.592643 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f258d7d-05b4-4af0-a99f-59c56428012c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.593169 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f258d7d-05b4-4af0-a99f-59c56428012c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.593664 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f258d7d-05b4-4af0-a99f-59c56428012c None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.594684 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f258d7d-05b4-4af0-a99f-59c56428012c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:05.595423 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f258d7d-05b4-4af0-a99f-59c56428012c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.597243 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f258d7d-05b4-4af0-a99f-59c56428012c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.608084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 93/186] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:05.609714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce775c2-e2e1-43eb-8510-919489cc19d6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.610196 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce775c2-e2e1-43eb-8510-919489cc19d6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.610700 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce775c2-e2e1-43eb-8510-919489cc19d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.627813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-dce775c2-e2e1-43eb-8510-919489cc19d6 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:05.629138 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-dce775c2-e2e1-43eb-8510-919489cc19d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:05.702763 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 94/187] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:05.703632 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce775c2-e2e1-43eb-8510-919489cc19d6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.719135 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c164f16-a84c-49cf-a527-5964b0e5ee0d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.724813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.760550 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b842c-f874-4e08-a526-3443cefcd6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.761403 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b842c-f874-4e08-a526-3443cefcd6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.761686 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b842c-f874-4e08-a526-3443cefcd6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.761961 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b842c-f874-4e08-a526-3443cefcd6b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.762806 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b842c-f874-4e08-a526-3443cefcd6b8 None admin] RBAC: Adding query filter params (role.id=2099e2212de24144b089730e7db8ed3a, scope.project.id=ac7846253ff8494cb07a57b9fef377e7, user.id=21b09299f25d4591a38f3b193aad3d4d) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:05.763112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b842c-f874-4e08-a526-3443cefcd6b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.764746 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b842c-f874-4e08-a526-3443cefcd6b8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.772762 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 94/188] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/role_assignments?user.id=21b09299f25d4591a38f3b193aad3d4d&scope.project.id=ac7846253ff8494cb07a57b9fef377e7&role.id=2099e2212de24144b089730e7db8ed3a => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:05.774494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b842c-f874-4e08-a526-3443cefcd6b8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.810423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.829253 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce775c2-e2e1-43eb-8510-919489cc19d6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.885240 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c62c72-8f0c-481b-b1fd-ade20fe8cc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.886679 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c62c72-8f0c-481b-b1fd-ade20fe8cc8d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.887135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c62c72-8f0c-481b-b1fd-ade20fe8cc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.887551 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c62c72-8f0c-481b-b1fd-ade20fe8cc8d None admin] PATH_INFO: `/v3/users/952d44da64ff4a0eb2ebed57174180d9` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.908910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c62c72-8f0c-481b-b1fd-ade20fe8cc8d None admin] RBAC: Authorizing `identity:get_user(user_id=952d44da64ff4a0eb2ebed57174180d9)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.910043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b842c-f874-4e08-a526-3443cefcd6b8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.910888 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c62c72-8f0c-481b-b1fd-ade20fe8cc8d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.913381 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 95/189] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/users/952d44da64ff4a0eb2ebed57174180d9 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:05.919191 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c62c72-8f0c-481b-b1fd-ade20fe8cc8d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.963396 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f864-6f30-418c-be30-154fbef02d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.964594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f864-6f30-418c-be30-154fbef02d14 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.965093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f864-6f30-418c-be30-154fbef02d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.965432 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f864-6f30-418c-be30-154fbef02d14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.966646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186f864-6f30-418c-be30-154fbef02d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.968102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186f864-6f30-418c-be30-154fbef02d14 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.971968 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 95/190] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:05.971968 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f864-6f30-418c-be30-154fbef02d14 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:06.025896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:06.051262 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c62c72-8f0c-481b-b1fd-ade20fe8cc8d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:06.079305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:06.091324 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb8590-bcd6-41e8-a609-8ce9f1626dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:06.092154 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8590-bcd6-41e8-a609-8ce9f1626dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.092438 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8590-bcd6-41e8-a609-8ce9f1626dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.092711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8590-bcd6-41e8-a609-8ce9f1626dd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.097414 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f864-6f30-418c-be30-154fbef02d14 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:06.105020 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb8590-bcd6-41e8-a609-8ce9f1626dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-26fb8590-bcd6-41e8-a609-8ce9f1626dd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:06.113322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:06.114208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 96/191] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:06.120173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb8590-bcd6-41e8-a609-8ce9f1626dd6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:06.135655 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bf164-6b4f-40f4-be07-e93d2b0bac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:06.136316 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bf164-6b4f-40f4-be07-e93d2b0bac60 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.136595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bf164-6b4f-40f4-be07-e93d2b0bac60 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.136866 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bf164-6b4f-40f4-be07-e93d2b0bac60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.205427 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bf164-6b4f-40f4-be07-e93d2b0bac60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:06.207002 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bf164-6b4f-40f4-be07-e93d2b0bac60 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:06.228590 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb8590-bcd6-41e8-a609-8ce9f1626dd6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:06.261032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176a0db-74c4-405d-b27a-86cfe4b168ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:06.261734 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176a0db-74c4-405d-b27a-86cfe4b168ae None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.262014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176a0db-74c4-405d-b27a-86cfe4b168ae None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.262285 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176a0db-74c4-405d-b27a-86cfe4b168ae None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.263006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176a0db-74c4-405d-b27a-86cfe4b168ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:06.264464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176a0db-74c4-405d-b27a-86cfe4b168ae None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:06.272094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:06.286971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 97/192] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:06 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:06.288685 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176a0db-74c4-405d-b27a-86cfe4b168ae None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:06.300615 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:06.325242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 96/193] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:06.326491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bf164-6b4f-40f4-be07-e93d2b0bac60 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:06.426241 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176a0db-74c4-405d-b27a-86cfe4b168ae None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:06.460638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bf164-6b4f-40f4-be07-e93d2b0bac60 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:06.470532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48b6f-3c9b-4642-91f2-a96455329ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:06.471271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48b6f-3c9b-4642-91f2-a96455329ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.471601 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48b6f-3c9b-4642-91f2-a96455329ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.472240 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48b6f-3c9b-4642-91f2-a96455329ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.473018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb48b6f-3c9b-4642-91f2-a96455329ee8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:06.474253 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb48b6f-3c9b-4642-91f2-a96455329ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:06.475975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb48b6f-3c9b-4642-91f2-a96455329ee8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:06.485741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 98/194] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:06.492116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48b6f-3c9b-4642-91f2-a96455329ee8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:06.506600 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18fb9e-087a-4124-9180-cde31f32ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:06.507622 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18fb9e-087a-4124-9180-cde31f32ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.507969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18fb9e-087a-4124-9180-cde31f32ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.508309 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18fb9e-087a-4124-9180-cde31f32ecf9 None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.509883 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18fb9e-087a-4124-9180-cde31f32ecf9 None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:06.511419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18fb9e-087a-4124-9180-cde31f32ecf9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:06.513985 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 97/195] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:06 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:06.519818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18fb9e-087a-4124-9180-cde31f32ecf9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:06.563378 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:06.585888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:06.628173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48b6f-3c9b-4642-91f2-a96455329ee8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:06.639672 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18fb9e-087a-4124-9180-cde31f32ecf9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:06.673193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854d22f-68ee-4c49-b042-cd5130fa2ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:06.674176 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d22f-68ee-4c49-b042-cd5130fa2ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.674489 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d22f-68ee-4c49-b042-cd5130fa2ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.674796 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d22f-68ee-4c49-b042-cd5130fa2ee2 None admin] PATH_INFO: `/v3/users/952d44da64ff4a0eb2ebed57174180d9` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.675985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854d22f-68ee-4c49-b042-cd5130fa2ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=952d44da64ff4a0eb2ebed57174180d9)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:06.677479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854d22f-68ee-4c49-b042-cd5130fa2ee2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:06.679349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 99/196] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:06 2022] GET /identity/v3/users/952d44da64ff4a0eb2ebed57174180d9 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:06.680250 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db37bd-fdb8-4238-a20e-2f3eefe13810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:06.680928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db37bd-fdb8-4238-a20e-2f3eefe13810 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.681246 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db37bd-fdb8-4238-a20e-2f3eefe13810 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.681524 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db37bd-fdb8-4238-a20e-2f3eefe13810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.682379 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db37bd-fdb8-4238-a20e-2f3eefe13810 None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=d96a406ef499477eb6b1ae5573304572, user.id=952d44da64ff4a0eb2ebed57174180d9) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:06.682686 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db37bd-fdb8-4238-a20e-2f3eefe13810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:06.684140 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db37bd-fdb8-4238-a20e-2f3eefe13810 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:06.685269 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854d22f-68ee-4c49-b042-cd5130fa2ee2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:06.690552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 98/197] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:06 2022] GET /identity/v3/role_assignments?user.id=952d44da64ff4a0eb2ebed57174180d9&scope.project.id=d96a406ef499477eb6b1ae5573304572&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:06.801319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854d22f-68ee-4c49-b042-cd5130fa2ee2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:06.830890 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:06.852908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877153b-c274-4641-bc64-6a7ef4d5ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:06.853682 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877153b-c274-4641-bc64-6a7ef4d5ed0c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.853970 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877153b-c274-4641-bc64-6a7ef4d5ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.854248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877153b-c274-4641-bc64-6a7ef4d5ed0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.932058 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877153b-c274-4641-bc64-6a7ef4d5ed0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:06.933621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877153b-c274-4641-bc64-6a7ef4d5ed0c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:07.073449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 100/198] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:07.078991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db37bd-fdb8-4238-a20e-2f3eefe13810 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:07.228894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db37bd-fdb8-4238-a20e-2f3eefe13810 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:07.251288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:07.273364 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16b30f-a6c3-4773-a073-fbc018edf8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:07.274289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16b30f-a6c3-4773-a073-fbc018edf8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.274581 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16b30f-a6c3-4773-a073-fbc018edf8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.274862 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16b30f-a6c3-4773-a073-fbc018edf8f1 None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.281956 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16b30f-a6c3-4773-a073-fbc018edf8f1 None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:07.283497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16b30f-a6c3-4773-a073-fbc018edf8f1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:07.285815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 99/199] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:07 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:07.291431 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877153b-c274-4641-bc64-6a7ef4d5ed0c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:07.335600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:07.439927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877153b-c274-4641-bc64-6a7ef4d5ed0c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:07.473410 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e039-8179-4a4c-aacf-5178d6afa8ca None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.473696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e039-8179-4a4c-aacf-5178d6afa8ca None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.473971 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e039-8179-4a4c-aacf-5178d6afa8ca None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.475410 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 100/200] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:07.483799 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65914d35-4430-4a0c-8b64-30271c126a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:07.484644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65914d35-4430-4a0c-8b64-30271c126a3e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.485091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65914d35-4430-4a0c-8b64-30271c126a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.485530 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65914d35-4430-4a0c-8b64-30271c126a3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.486565 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65914d35-4430-4a0c-8b64-30271c126a3e None admin] RBAC: Adding query filter params (role.id=d91e55b589bd4b9aaab2ab607f087f8d, scope.project.id=d96a406ef499477eb6b1ae5573304572, user.id=952d44da64ff4a0eb2ebed57174180d9) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:07.487189 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65914d35-4430-4a0c-8b64-30271c126a3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:07.488812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65914d35-4430-4a0c-8b64-30271c126a3e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:07.496537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be3c30-f1c4-432a-831e-2127aec6bcac None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.496537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be3c30-f1c4-432a-831e-2127aec6bcac None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.496537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be3c30-f1c4-432a-831e-2127aec6bcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.499914 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 101/201] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:07 2022] GET /identity/v3/role_assignments?user.id=952d44da64ff4a0eb2ebed57174180d9&scope.project.id=d96a406ef499477eb6b1ae5573304572&role.id=d91e55b589bd4b9aaab2ab607f087f8d => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:07.513700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-99be3c30-f1c4-432a-831e-2127aec6bcac None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:07.514932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-99be3c30-f1c4-432a-831e-2127aec6bcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:07.585725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 101/202] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:07.623076 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65914d35-4430-4a0c-8b64-30271c126a3e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:07.746319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:07.768086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65914d35-4430-4a0c-8b64-30271c126a3e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:07.818174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6eb341-3b22-475d-9166-2fe3b6d81f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:07.819298 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6eb341-3b22-475d-9166-2fe3b6d81f29 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.819737 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6eb341-3b22-475d-9166-2fe3b6d81f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.820178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6eb341-3b22-475d-9166-2fe3b6d81f29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.833664 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6eb341-3b22-475d-9166-2fe3b6d81f29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-2d6eb341-3b22-475d-9166-2fe3b6d81f29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:07.842178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:07.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:07.844271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 102/203] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:07.849526 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be3c30-f1c4-432a-831e-2127aec6bcac None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.001667 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be3c30-f1c4-432a-831e-2127aec6bcac None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:08.028590 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:08.055234 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704ed66-ce67-4589-828a-a94e62450121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:08.055927 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704ed66-ce67-4589-828a-a94e62450121 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.056215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704ed66-ce67-4589-828a-a94e62450121 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.056491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704ed66-ce67-4589-828a-a94e62450121 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.057272 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704ed66-ce67-4589-828a-a94e62450121 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:08.057582 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704ed66-ce67-4589-828a-a94e62450121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:08.058977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704ed66-ce67-4589-828a-a94e62450121 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:08.072833 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 102/204] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:08.078679 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6eb341-3b22-475d-9166-2fe3b6d81f29 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.235189 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6eb341-3b22-475d-9166-2fe3b6d81f29 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:08.285433 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d367cf0-a2b8-47ef-a594-1f8adc8ee426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:08.286681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d367cf0-a2b8-47ef-a594-1f8adc8ee426 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.287141 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d367cf0-a2b8-47ef-a594-1f8adc8ee426 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.287592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d367cf0-a2b8-47ef-a594-1f8adc8ee426 None admin] PATH_INFO: `/v3/users/064f0dae4c8842db95fcdcfd46ccec8c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.289904 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d367cf0-a2b8-47ef-a594-1f8adc8ee426 None admin] RBAC: Authorizing `identity:get_user(user_id=064f0dae4c8842db95fcdcfd46ccec8c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:08.291550 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d367cf0-a2b8-47ef-a594-1f8adc8ee426 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:08.293424 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 103/205] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:08 2022] GET /identity/v3/users/064f0dae4c8842db95fcdcfd46ccec8c => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:08.299068 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704ed66-ce67-4589-828a-a94e62450121 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.437434 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704ed66-ce67-4589-828a-a94e62450121 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:08.487793 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced05e-efb7-413d-bfd8-aec53ce7b280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:08.488382 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced05e-efb7-413d-bfd8-aec53ce7b280 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.488666 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced05e-efb7-413d-bfd8-aec53ce7b280 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.488951 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced05e-efb7-413d-bfd8-aec53ce7b280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.554254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:08.586056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edced05e-efb7-413d-bfd8-aec53ce7b280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:08.586275 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edced05e-efb7-413d-bfd8-aec53ce7b280 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:08.725978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 103/206] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:08.731651 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d367cf0-a2b8-47ef-a594-1f8adc8ee426 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.768972 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:08.898377 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d367cf0-a2b8-47ef-a594-1f8adc8ee426 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:08.945234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df200639-c1a3-4fa1-95f1-eb355470e8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:08.946125 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df200639-c1a3-4fa1-95f1-eb355470e8cc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.946406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df200639-c1a3-4fa1-95f1-eb355470e8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.946680 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df200639-c1a3-4fa1-95f1-eb355470e8cc None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.947902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df200639-c1a3-4fa1-95f1-eb355470e8cc None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:08.949400 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df200639-c1a3-4fa1-95f1-eb355470e8cc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:08.951326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 104/207] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:08 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:08.957369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced05e-efb7-413d-bfd8-aec53ce7b280 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.992594 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a722989-bf89-4a0e-8d42-083c98e8f325 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.992929 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a722989-bf89-4a0e-8d42-083c98e8f325 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.993158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a722989-bf89-4a0e-8d42-083c98e8f325 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.994718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 105/208] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:09.003921 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18344c-8778-4411-8b2e-d4fc43a74479 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.004799 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18344c-8778-4411-8b2e-d4fc43a74479 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.005086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18344c-8778-4411-8b2e-d4fc43a74479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.042874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7b18344c-8778-4411-8b2e-d4fc43a74479 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:09.044015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7b18344c-8778-4411-8b2e-d4fc43a74479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:09.090681 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:09.114618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced05e-efb7-413d-bfd8-aec53ce7b280 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.131969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 106/209] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:09.133714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a638c-35b5-46f9-bdad-a3bda0ae5b63 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.134209 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a638c-35b5-46f9-bdad-a3bda0ae5b63 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.134723 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a638c-35b5-46f9-bdad-a3bda0ae5b63 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.136354 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 107/210] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:09.142014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569549-ac1e-4eef-8209-c1096348ece8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.142550 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569549-ac1e-4eef-8209-c1096348ece8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.143023 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569549-ac1e-4eef-8209-c1096348ece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.153532 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394a933-79d1-4c6c-b776-e781fb2c8ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.153532 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394a933-79d1-4c6c-b776-e781fb2c8ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.153532 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394a933-79d1-4c6c-b776-e781fb2c8ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.153532 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394a933-79d1-4c6c-b776-e781fb2c8ce6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.153899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394a933-79d1-4c6c-b776-e781fb2c8ce6 None admin] RBAC: Adding query filter params (role.id=56edef813db54c3c826f9af018142f20, scope.project.id=4a8d6d084fc142bf96584a8573fbabd6, user.id=064f0dae4c8842db95fcdcfd46ccec8c) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:09.153899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394a933-79d1-4c6c-b776-e781fb2c8ce6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:09.153899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394a933-79d1-4c6c-b776-e781fb2c8ce6 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:09.159653 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 104/211] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:08 2022] GET /identity/v3/role_assignments?user.id=064f0dae4c8842db95fcdcfd46ccec8c&scope.project.id=4a8d6d084fc142bf96584a8573fbabd6&role.id=56edef813db54c3c826f9af018142f20 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:09.166201 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394a933-79d1-4c6c-b776-e781fb2c8ce6 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:09.168292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ae569549-ac1e-4eef-8209-c1096348ece8 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:09.169870 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ae569549-ac1e-4eef-8209-c1096348ece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:09.186694 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:09.274891 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394a933-79d1-4c6c-b776-e781fb2c8ce6 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.312939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f1037-aff6-43ed-ad2c-b2f42bbffc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.313890 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f1037-aff6-43ed-ad2c-b2f42bbffc4f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.314270 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f1037-aff6-43ed-ad2c-b2f42bbffc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.314644 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f1037-aff6-43ed-ad2c-b2f42bbffc4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.316059 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f1037-aff6-43ed-ad2c-b2f42bbffc4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:09.321228 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f1037-aff6-43ed-ad2c-b2f42bbffc4f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:09.321228 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 105/212] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:09.325128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f1037-aff6-43ed-ad2c-b2f42bbffc4f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:09.325936 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 108/213] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:09.339217 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:09.369397 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae569549-ac1e-4eef-8209-c1096348ece8 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:09.437991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f1037-aff6-43ed-ad2c-b2f42bbffc4f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.478564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942707cb-18a1-4da8-8d76-918cd4bd7928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.479702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942707cb-18a1-4da8-8d76-918cd4bd7928 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.480051 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942707cb-18a1-4da8-8d76-918cd4bd7928 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.480399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942707cb-18a1-4da8-8d76-918cd4bd7928 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.481231 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942707cb-18a1-4da8-8d76-918cd4bd7928 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:09.482788 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942707cb-18a1-4da8-8d76-918cd4bd7928 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:09.506751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 106/214] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:09 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:52:09.507925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5bcc-3d7b-4c6c-97ae-0931dea4bd0e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.508219 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5bcc-3d7b-4c6c-97ae-0931dea4bd0e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.508500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5bcc-3d7b-4c6c-97ae-0931dea4bd0e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.509800 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 107/215] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:09.517366 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d538b13-387c-4165-bb99-f37427c3dae8 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.517677 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d538b13-387c-4165-bb99-f37427c3dae8 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.517931 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d538b13-387c-4165-bb99-f37427c3dae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.531092 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae569549-ac1e-4eef-8209-c1096348ece8 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.539093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6d538b13-387c-4165-bb99-f37427c3dae8 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:09.540332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6d538b13-387c-4165-bb99-f37427c3dae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:09.579883 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3b9b7-9ce0-412a-9331-7b23ee5a8bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.581162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3b9b7-9ce0-412a-9331-7b23ee5a8bee None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.581672 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3b9b7-9ce0-412a-9331-7b23ee5a8bee None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.582155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3b9b7-9ce0-412a-9331-7b23ee5a8bee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.598627 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3b9b7-9ce0-412a-9331-7b23ee5a8bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-e7c3b9b7-9ce0-412a-9331-7b23ee5a8bee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:09.611086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:09.612156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:09.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:09.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:09.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:09.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:09.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:09.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:09.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:09.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:09.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:09.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:09.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:09.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:09.615775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 109/216] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:09.624144 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3b9b7-9ce0-412a-9331-7b23ee5a8bee None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:09.629587 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:09.641650 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:09.657573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 108/217] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:09.683571 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d538b13-387c-4165-bb99-f37427c3dae8 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:09.751392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3b9b7-9ce0-412a-9331-7b23ee5a8bee None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.791563 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb6261-fa3c-4112-aa09-5117670d381e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.793179 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb6261-fa3c-4112-aa09-5117670d381e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.793179 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb6261-fa3c-4112-aa09-5117670d381e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.793627 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb6261-fa3c-4112-aa09-5117670d381e None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.794398 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb6261-fa3c-4112-aa09-5117670d381e None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:09.794712 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb6261-fa3c-4112-aa09-5117670d381e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:09.796123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb6261-fa3c-4112-aa09-5117670d381e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:09.799230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d538b13-387c-4165-bb99-f37427c3dae8 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.807252 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 110/218] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:09.816641 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb6261-fa3c-4112-aa09-5117670d381e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:09.853181 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43040b45-39b9-4a66-bcd1-5bcc53c9de1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.854311 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43040b45-39b9-4a66-bcd1-5bcc53c9de1b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.854600 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43040b45-39b9-4a66-bcd1-5bcc53c9de1b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.855036 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43040b45-39b9-4a66-bcd1-5bcc53c9de1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.867232 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43040b45-39b9-4a66-bcd1-5bcc53c9de1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-43040b45-39b9-4a66-bcd1-5bcc53c9de1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:09.875099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:09.876007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:09.876874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 109/219] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:09.891191 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43040b45-39b9-4a66-bcd1-5bcc53c9de1b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:09.901510 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:09.944252 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb6261-fa3c-4112-aa09-5117670d381e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.960905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:09.988115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6e565-eb65-4a04-8515-865e4b278889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.989174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6e565-eb65-4a04-8515-865e4b278889 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.989713 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6e565-eb65-4a04-8515-865e4b278889 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.990080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6e565-eb65-4a04-8515-865e4b278889 None admin] PATH_INFO: `/v3/users/237cc770396b4b8e849026165b9913ff` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.007370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6e565-eb65-4a04-8515-865e4b278889 None admin] RBAC: Authorizing `identity:get_user(user_id=237cc770396b4b8e849026165b9913ff)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:10.009647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6e565-eb65-4a04-8515-865e4b278889 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:10.012316 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 111/220] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:09 2022] GET /identity/v3/users/237cc770396b4b8e849026165b9913ff => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:10.015859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7172f5-04ed-46d7-8278-94d26d31e6bf None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.015859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7172f5-04ed-46d7-8278-94d26d31e6bf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.015859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7172f5-04ed-46d7-8278-94d26d31e6bf None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.016091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 112/221] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:10.019237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7172f5-04ed-46d7-8278-94d26d31e6bf None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:10.023173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43040b45-39b9-4a66-bcd1-5bcc53c9de1b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:10.058585 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1daca1-3727-4fe2-82f0-8dd8abc971ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:10.059386 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1daca1-3727-4fe2-82f0-8dd8abc971ab None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.059737 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1daca1-3727-4fe2-82f0-8dd8abc971ab None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.060083 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1daca1-3727-4fe2-82f0-8dd8abc971ab None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.060919 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1daca1-3727-4fe2-82f0-8dd8abc971ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:10.061321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1daca1-3727-4fe2-82f0-8dd8abc971ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:10.062809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1daca1-3727-4fe2-82f0-8dd8abc971ab None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:10.072160 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 110/222] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:10.078043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe87277-59b4-4cf4-a42a-1caefeb0d2ea None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.078429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe87277-59b4-4cf4-a42a-1caefeb0d2ea None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.079105 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe87277-59b4-4cf4-a42a-1caefeb0d2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.096062 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6fe87277-59b4-4cf4-a42a-1caefeb0d2ea None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:10.097749 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6fe87277-59b4-4cf4-a42a-1caefeb0d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:10.129104 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7172f5-04ed-46d7-8278-94d26d31e6bf None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:10.153171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:10.166270 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bfeb9-a451-453a-9533-e0c958689183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:10.167283 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bfeb9-a451-453a-9533-e0c958689183 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.167863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bfeb9-a451-453a-9533-e0c958689183 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.168336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bfeb9-a451-453a-9533-e0c958689183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.169695 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 111/223] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:10.170546 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe87277-59b4-4cf4-a42a-1caefeb0d2ea None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:10.240506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bfeb9-a451-453a-9533-e0c958689183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:10.242580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bfeb9-a451-453a-9533-e0c958689183 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:10.246790 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:10.305447 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe87277-59b4-4cf4-a42a-1caefeb0d2ea None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:10.342344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b7ef2-7281-401d-859c-02fa5ed5586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:10.343246 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b7ef2-7281-401d-859c-02fa5ed5586a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.343818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b7ef2-7281-401d-859c-02fa5ed5586a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.343925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b7ef2-7281-401d-859c-02fa5ed5586a None admin] PATH_INFO: `/v3/users/952d44da64ff4a0eb2ebed57174180d9` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.345086 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b7ef2-7281-401d-859c-02fa5ed5586a None admin] RBAC: Authorizing `identity:get_user(user_id=952d44da64ff4a0eb2ebed57174180d9)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:10.346754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b7ef2-7281-401d-859c-02fa5ed5586a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:10.348524 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 112/224] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:10 2022] GET /identity/v3/users/952d44da64ff4a0eb2ebed57174180d9 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:10.355850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b7ef2-7281-401d-859c-02fa5ed5586a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:10.356128 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 113/225] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:52:10.357313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bfeb9-a451-453a-9533-e0c958689183 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:10.382461 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:10.462181 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b7ef2-7281-401d-859c-02fa5ed5586a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:10.462957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bfeb9-a451-453a-9533-e0c958689183 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:10.480311 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:10.501370 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f385c6-54f9-4221-9f01-b4060f321c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:10.502582 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f385c6-54f9-4221-9f01-b4060f321c05 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.503028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ba898-fa29-4bfc-83bf-fa517bc514ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:10.503191 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f385c6-54f9-4221-9f01-b4060f321c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.503592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f385c6-54f9-4221-9f01-b4060f321c05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.504223 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ba898-fa29-4bfc-83bf-fa517bc514ec None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.504558 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ba898-fa29-4bfc-83bf-fa517bc514ec None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.504925 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ba898-fa29-4bfc-83bf-fa517bc514ec None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.506309 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ba898-fa29-4bfc-83bf-fa517bc514ec None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:10.507872 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ba898-fa29-4bfc-83bf-fa517bc514ec None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:10.509984 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 114/226] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:10 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:10.515567 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ba898-fa29-4bfc-83bf-fa517bc514ec None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:10.516606 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f385c6-54f9-4221-9f01-b4060f321c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-54f385c6-54f9-4221-9f01-b4060f321c05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:10.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:10.526415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:10.527218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:10.527218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:10.527218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:10.527218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:10.527218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:10.527218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:10.527218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:10.527218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:10.527218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:10.527218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:10.527218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:10.527218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:10.534623 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 113/227] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:10.536578 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f385c6-54f9-4221-9f01-b4060f321c05 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:10.619493 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:10.629278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ba898-fa29-4bfc-83bf-fa517bc514ec None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:10.648137 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f385c6-54f9-4221-9f01-b4060f321c05 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:10.664217 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fcc84-1304-428e-940c-6b62a3f1076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:10.665014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fcc84-1304-428e-940c-6b62a3f1076c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.665327 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fcc84-1304-428e-940c-6b62a3f1076c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.665607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fcc84-1304-428e-940c-6b62a3f1076c None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.666805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fcc84-1304-428e-940c-6b62a3f1076c None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:10.668286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fcc84-1304-428e-940c-6b62a3f1076c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:10.674723 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 115/228] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:10 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:10.674723 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fcc84-1304-428e-940c-6b62a3f1076c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:10.694032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b49253-7544-4d62-b555-cf0ef09c2314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:10.694978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b49253-7544-4d62-b555-cf0ef09c2314 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.695269 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b49253-7544-4d62-b555-cf0ef09c2314 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.695607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b49253-7544-4d62-b555-cf0ef09c2314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.696463 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b49253-7544-4d62-b555-cf0ef09c2314 None admin] RBAC: Adding query filter params (role.id=2099e2212de24144b089730e7db8ed3a, scope.project.id=d96a406ef499477eb6b1ae5573304572, user.id=237cc770396b4b8e849026165b9913ff) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:10.696979 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b49253-7544-4d62-b555-cf0ef09c2314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:10.698864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b49253-7544-4d62-b555-cf0ef09c2314 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:10.705900 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 114/229] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:10 2022] GET /identity/v3/role_assignments?user.id=237cc770396b4b8e849026165b9913ff&scope.project.id=d96a406ef499477eb6b1ae5573304572&role.id=2099e2212de24144b089730e7db8ed3a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:10.709504 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b49253-7544-4d62-b555-cf0ef09c2314 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:10.804648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:10.884787 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fcc84-1304-428e-940c-6b62a3f1076c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:10.919514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b49253-7544-4d62-b555-cf0ef09c2314 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:10.951440 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b65db1-3d56-4db3-8e06-26c2a0f9a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:10.952883 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b65db1-3d56-4db3-8e06-26c2a0f9a2cf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.953437 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b65db1-3d56-4db3-8e06-26c2a0f9a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.953905 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b65db1-3d56-4db3-8e06-26c2a0f9a2cf None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.954910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b65db1-3d56-4db3-8e06-26c2a0f9a2cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:10.955408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b65db1-3d56-4db3-8e06-26c2a0f9a2cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:10.957338 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b65db1-3d56-4db3-8e06-26c2a0f9a2cf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:10.976144 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 116/230] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:10.989109 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b65db1-3d56-4db3-8e06-26c2a0f9a2cf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:11.000954 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accaad3-5391-4c4e-9f4a-acceea359223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:11.002262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accaad3-5391-4c4e-9f4a-acceea359223 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.002845 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accaad3-5391-4c4e-9f4a-acceea359223 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.003564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accaad3-5391-4c4e-9f4a-acceea359223 None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572/users/952d44da64ff4a0eb2ebed57174180d9/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.007654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accaad3-5391-4c4e-9f4a-acceea359223 None admin] RBAC: Authorizing `identity:create_grant(project_id=d96a406ef499477eb6b1ae5573304572, user_id=952d44da64ff4a0eb2ebed57174180d9, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:11.010835 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accaad3-5391-4c4e-9f4a-acceea359223 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:11.025577 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:11.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 115/231] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:10 2022] PUT /identity/v3/projects/d96a406ef499477eb6b1ae5573304572/users/952d44da64ff4a0eb2ebed57174180d9/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:11.139315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b65db1-3d56-4db3-8e06-26c2a0f9a2cf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:11.182041 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3aa7b-be7f-4529-8418-7655f28899dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:11.183317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3aa7b-be7f-4529-8418-7655f28899dc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.183797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3aa7b-be7f-4529-8418-7655f28899dc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.184294 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3aa7b-be7f-4529-8418-7655f28899dc None admin] PATH_INFO: `/v3/users/952d44da64ff4a0eb2ebed57174180d9` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.185744 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3aa7b-be7f-4529-8418-7655f28899dc None admin] RBAC: Authorizing `identity:get_user(user_id=952d44da64ff4a0eb2ebed57174180d9)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:11.187408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3aa7b-be7f-4529-8418-7655f28899dc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:11.189320 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 117/232] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:10 2022] GET /identity/v3/users/952d44da64ff4a0eb2ebed57174180d9 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:11.195399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accaad3-5391-4c4e-9f4a-acceea359223 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:11.325222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:11.328526 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accaad3-5391-4c4e-9f4a-acceea359223 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:11.370910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd612e3-883d-44e5-98f6-3c66c98cc924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:11.372593 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd612e3-883d-44e5-98f6-3c66c98cc924 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.373070 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd612e3-883d-44e5-98f6-3c66c98cc924 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.373595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd612e3-883d-44e5-98f6-3c66c98cc924 None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.375000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd612e3-883d-44e5-98f6-3c66c98cc924 None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:11.376794 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd612e3-883d-44e5-98f6-3c66c98cc924 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:11.378781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 116/233] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:11 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:11.384835 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3aa7b-be7f-4529-8418-7655f28899dc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:11.484460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:11.498237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3aa7b-be7f-4529-8418-7655f28899dc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:11.551387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218586d-5fe9-447b-8a5a-78f8b5515b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:11.552679 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218586d-5fe9-447b-8a5a-78f8b5515b9a None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.553254 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218586d-5fe9-447b-8a5a-78f8b5515b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.553752 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218586d-5fe9-447b-8a5a-78f8b5515b9a None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572/users/952d44da64ff4a0eb2ebed57174180d9/roles/d91e55b589bd4b9aaab2ab607f087f8d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.556251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218586d-5fe9-447b-8a5a-78f8b5515b9a None admin] RBAC: Authorizing `identity:create_grant(project_id=d96a406ef499477eb6b1ae5573304572, user_id=952d44da64ff4a0eb2ebed57174180d9, role_id=d91e55b589bd4b9aaab2ab607f087f8d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:11.558019 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218586d-5fe9-447b-8a5a-78f8b5515b9a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:11.592466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 118/234] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:11 2022] PUT /identity/v3/projects/d96a406ef499477eb6b1ae5573304572/users/952d44da64ff4a0eb2ebed57174180d9/roles/d91e55b589bd4b9aaab2ab607f087f8d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:52:11.947865 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d144e-3960-4fca-a523-5e55ef80197c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.948263 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d144e-3960-4fca-a523-5e55ef80197c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.948435 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d144e-3960-4fca-a523-5e55ef80197c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.950106 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 117/235] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:11.955560 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e04f5b-2111-40ad-9842-a31962010d84 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.956124 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e04f5b-2111-40ad-9842-a31962010d84 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.956297 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e04f5b-2111-40ad-9842-a31962010d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.978439 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83ff28-c076-45fc-8dd7-4a5756c338a8 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.978623 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-80e04f5b-2111-40ad-9842-a31962010d84 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:11.978700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83ff28-c076-45fc-8dd7-4a5756c338a8 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.978982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83ff28-c076-45fc-8dd7-4a5756c338a8 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.979681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-80e04f5b-2111-40ad-9842-a31962010d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:11.980598 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 118/236] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:11.985864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde9b52-12ac-4b2e-b2d3-453fe13c1f58 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.986154 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde9b52-12ac-4b2e-b2d3-453fe13c1f58 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.986429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde9b52-12ac-4b2e-b2d3-453fe13c1f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.014249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6cde9b52-12ac-4b2e-b2d3-453fe13c1f58 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:12.015436 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6cde9b52-12ac-4b2e-b2d3-453fe13c1f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:12.105365 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 119/237] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:12.130041 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e04f5b-2111-40ad-9842-a31962010d84 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:12.137958 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 119/238] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:12.164042 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde9b52-12ac-4b2e-b2d3-453fe13c1f58 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:12.236479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:12.261883 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e04f5b-2111-40ad-9842-a31962010d84 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:12.334822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:12.335709 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2170ea-12f7-4431-90b2-5f4a733e5542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:12.336636 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2170ea-12f7-4431-90b2-5f4a733e5542 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.337021 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2170ea-12f7-4431-90b2-5f4a733e5542 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.337408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2170ea-12f7-4431-90b2-5f4a733e5542 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.340655 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde9b52-12ac-4b2e-b2d3-453fe13c1f58 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:12.360314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2170ea-12f7-4431-90b2-5f4a733e5542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-6c2170ea-12f7-4431-90b2-5f4a733e5542 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:12.368170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:12.369292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:12.370115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:12.370115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:12.370115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:12.370115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:12.370115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:12.370115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:12.370115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:12.370115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:12.370115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:12.370115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:12.370115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:12.370115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:12.370739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 120/239] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:12.376587 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2170ea-12f7-4431-90b2-5f4a733e5542 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:12.379924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f787e3d-b3a6-4ef3-b4ce-5dc06aae0eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:12.381531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f787e3d-b3a6-4ef3-b4ce-5dc06aae0eae None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.382040 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f787e3d-b3a6-4ef3-b4ce-5dc06aae0eae None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.382504 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f787e3d-b3a6-4ef3-b4ce-5dc06aae0eae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.384111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f787e3d-b3a6-4ef3-b4ce-5dc06aae0eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:12.385836 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f787e3d-b3a6-4ef3-b4ce-5dc06aae0eae None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:12.387800 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 120/240] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:12.399815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f787e3d-b3a6-4ef3-b4ce-5dc06aae0eae None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:12.606131 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f787e3d-b3a6-4ef3-b4ce-5dc06aae0eae None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:12.629066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2170ea-12f7-4431-90b2-5f4a733e5542 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:12.643630 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548dac5-dfc2-4eab-a432-ba3b5b7988b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:12.644671 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548dac5-dfc2-4eab-a432-ba3b5b7988b2 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.645172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548dac5-dfc2-4eab-a432-ba3b5b7988b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.645683 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548dac5-dfc2-4eab-a432-ba3b5b7988b2 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.648506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548dac5-dfc2-4eab-a432-ba3b5b7988b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:12.650237 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548dac5-dfc2-4eab-a432-ba3b5b7988b2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:12.687699 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 121/241] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:12 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:52:12.705317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2393a-bfaa-4002-951a-651f58317366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:12.706613 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2393a-bfaa-4002-951a-651f58317366 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.707106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2393a-bfaa-4002-951a-651f58317366 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.707750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2393a-bfaa-4002-951a-651f58317366 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.708791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2393a-bfaa-4002-951a-651f58317366 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:12.709358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2393a-bfaa-4002-951a-651f58317366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:12.711035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2393a-bfaa-4002-951a-651f58317366 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:12.723525 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:12.729437 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 121/242] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:12.735129 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548dac5-dfc2-4eab-a432-ba3b5b7988b2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:12.779374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:12.885182 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548dac5-dfc2-4eab-a432-ba3b5b7988b2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:12.926427 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66362f45-f12e-4784-a63f-b581d26753b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:12.927352 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66362f45-f12e-4784-a63f-b581d26753b8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.927635 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66362f45-f12e-4784-a63f-b581d26753b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.927910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66362f45-f12e-4784-a63f-b581d26753b8 None admin] PATH_INFO: `/v3/users/a1549d38660b44a5afde78347aff4a9a` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.946616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66362f45-f12e-4784-a63f-b581d26753b8 None admin] RBAC: Authorizing `identity:get_user(user_id=a1549d38660b44a5afde78347aff4a9a)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:12.948158 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66362f45-f12e-4784-a63f-b581d26753b8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:12.950503 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 122/243] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:12 2022] GET /identity/v3/users/a1549d38660b44a5afde78347aff4a9a => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:12.956165 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2393a-bfaa-4002-951a-651f58317366 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:13.077569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2393a-bfaa-4002-951a-651f58317366 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:13.122337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea32f25-ab3c-4e82-9c54-f1809a708f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:13.123015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea32f25-ab3c-4e82-9c54-f1809a708f3b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.123296 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea32f25-ab3c-4e82-9c54-f1809a708f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.123571 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea32f25-ab3c-4e82-9c54-f1809a708f3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.197943 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:13.203273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea32f25-ab3c-4e82-9c54-f1809a708f3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:13.204997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea32f25-ab3c-4e82-9c54-f1809a708f3b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:13.214389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f0997-aa27-49da-b9c8-ee6861078c39 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.214698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f0997-aa27-49da-b9c8-ee6861078c39 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.214948 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f0997-aa27-49da-b9c8-ee6861078c39 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.220313 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 123/244] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:13.223924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb064b2-3fbd-467a-8124-5071522bfc96 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.224208 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb064b2-3fbd-467a-8124-5071522bfc96 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.224485 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb064b2-3fbd-467a-8124-5071522bfc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.243431 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-bfb064b2-3fbd-467a-8124-5071522bfc96 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:13.244626 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bfb064b2-3fbd-467a-8124-5071522bfc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:13.333337 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 124/245] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:13.344424 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 122/246] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:13.350290 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb064b2-3fbd-467a-8124-5071522bfc96 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:13.354841 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea32f25-ab3c-4e82-9c54-f1809a708f3b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:13.365643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:13.469032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb064b2-3fbd-467a-8124-5071522bfc96 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:13.478997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea32f25-ab3c-4e82-9c54-f1809a708f3b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:13.487802 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:13.507669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537e3af-1f54-48a2-b91e-26bfa737245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:13.508580 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537e3af-1f54-48a2-b91e-26bfa737245b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.509116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537e3af-1f54-48a2-b91e-26bfa737245b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.509449 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537e3af-1f54-48a2-b91e-26bfa737245b None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.514067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537e3af-1f54-48a2-b91e-26bfa737245b None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:13.515502 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537e3af-1f54-48a2-b91e-26bfa737245b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:13.517645 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 125/247] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:13 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:13.523274 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537e3af-1f54-48a2-b91e-26bfa737245b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:13.524505 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9f102-6bb5-40b8-b0ba-8215cd837594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:13.525559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9f102-6bb5-40b8-b0ba-8215cd837594 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.525982 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9f102-6bb5-40b8-b0ba-8215cd837594 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.526417 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9f102-6bb5-40b8-b0ba-8215cd837594 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.539709 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9f102-6bb5-40b8-b0ba-8215cd837594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f1c9f102-6bb5-40b8-b0ba-8215cd837594 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:13.548055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:13.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:13.549891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:13.549891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:13.549891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:13.549891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:13.549891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:13.549891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:13.549891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:13.549891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:13.549891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:13.549891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:13.549891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:13.549891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:13.552688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 123/248] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:13.559755 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9f102-6bb5-40b8-b0ba-8215cd837594 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:13.611146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:13.636206 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537e3af-1f54-48a2-b91e-26bfa737245b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:13.706165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29666a4c-28b3-4f06-aa25-459c40fed8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:13.707119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666a4c-28b3-4f06-aa25-459c40fed8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.707539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666a4c-28b3-4f06-aa25-459c40fed8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.707944 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666a4c-28b3-4f06-aa25-459c40fed8f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.708919 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29666a4c-28b3-4f06-aa25-459c40fed8f7 None admin] RBAC: Adding query filter params (role.id=56edef813db54c3c826f9af018142f20, scope.project.id=d96a406ef499477eb6b1ae5573304572, user.id=a1549d38660b44a5afde78347aff4a9a) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:13.709621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29666a4c-28b3-4f06-aa25-459c40fed8f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:13.713022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29666a4c-28b3-4f06-aa25-459c40fed8f7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:13.726006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 126/249] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:13 2022] GET /identity/v3/role_assignments?user.id=a1549d38660b44a5afde78347aff4a9a&scope.project.id=d96a406ef499477eb6b1ae5573304572&role.id=56edef813db54c3c826f9af018142f20 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:13.728242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf32253-c415-4d1c-abb0-c9e4e703b894 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.729552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf32253-c415-4d1c-abb0-c9e4e703b894 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.730663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf32253-c415-4d1c-abb0-c9e4e703b894 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.733971 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 127/250] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:13.738503 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e24a13-a631-4a70-8aad-e00298d9089b None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.739725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e24a13-a631-4a70-8aad-e00298d9089b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.740154 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e24a13-a631-4a70-8aad-e00298d9089b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.750344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9f102-6bb5-40b8-b0ba-8215cd837594 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:13.774600 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-79e24a13-a631-4a70-8aad-e00298d9089b None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:13.776315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-79e24a13-a631-4a70-8aad-e00298d9089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:13.818843 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d390e-c3a3-4dfa-a67e-4acb7fddd240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:13.819869 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d390e-c3a3-4dfa-a67e-4acb7fddd240 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.821480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d390e-c3a3-4dfa-a67e-4acb7fddd240 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.821923 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d390e-c3a3-4dfa-a67e-4acb7fddd240 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.822983 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d390e-c3a3-4dfa-a67e-4acb7fddd240 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:13.824628 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d390e-c3a3-4dfa-a67e-4acb7fddd240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:13.826569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d390e-c3a3-4dfa-a67e-4acb7fddd240 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:13.845694 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 124/251] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:13.850020 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d390e-c3a3-4dfa-a67e-4acb7fddd240 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:13.891756 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:13.908200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 128/252] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:13.934910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e24a13-a631-4a70-8aad-e00298d9089b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:14.021004 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:14.079238 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d390e-c3a3-4dfa-a67e-4acb7fddd240 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:14.089529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e24a13-a631-4a70-8aad-e00298d9089b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:14.156335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93f7c7-e353-4297-b3e9-a93c6e2f381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:14.157298 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93f7c7-e353-4297-b3e9-a93c6e2f381b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.157971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93f7c7-e353-4297-b3e9-a93c6e2f381b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.158268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93f7c7-e353-4297-b3e9-a93c6e2f381b None admin] PATH_INFO: `/v3/users/237cc770396b4b8e849026165b9913ff` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.162202 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93f7c7-e353-4297-b3e9-a93c6e2f381b None admin] RBAC: Authorizing `identity:get_user(user_id=237cc770396b4b8e849026165b9913ff)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:14.163693 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93f7c7-e353-4297-b3e9-a93c6e2f381b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:14.165801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 125/253] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:13 2022] GET /identity/v3/users/237cc770396b4b8e849026165b9913ff => generated 297 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:14.169438 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eb123-494f-4b41-852a-8c924535a313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:14.170580 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eb123-494f-4b41-852a-8c924535a313 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.170946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93f7c7-e353-4297-b3e9-a93c6e2f381b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:14.171273 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eb123-494f-4b41-852a-8c924535a313 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.171750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eb123-494f-4b41-852a-8c924535a313 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.199913 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eb123-494f-4b41-852a-8c924535a313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-9f9eb123-494f-4b41-852a-8c924535a313 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:14.208169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:14.209064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:14.209903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:14.209903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:14.209903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:14.209903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:14.209903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:14.209903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:14.209903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:14.209903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:14.209903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:14.209903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:14.209903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:14.209903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:14.218481 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 129/254] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:14.228915 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eb123-494f-4b41-852a-8c924535a313 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:14.347284 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:14.368994 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93f7c7-e353-4297-b3e9-a93c6e2f381b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:14.426534 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c60ab-758f-469c-b5c8-2920cf50c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:14.427427 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c60ab-758f-469c-b5c8-2920cf50c9db None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.427714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c60ab-758f-469c-b5c8-2920cf50c9db None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.429242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c60ab-758f-469c-b5c8-2920cf50c9db None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.434413 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c60ab-758f-469c-b5c8-2920cf50c9db None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:14.436367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c60ab-758f-469c-b5c8-2920cf50c9db None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:14.438850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 126/255] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:14 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:14.444629 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c60ab-758f-469c-b5c8-2920cf50c9db None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:14.459107 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eb123-494f-4b41-852a-8c924535a313 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:14.521586 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:14.533875 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702aed0-b1eb-4076-a6db-001f435d5945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:14.534957 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702aed0-b1eb-4076-a6db-001f435d5945 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.535480 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702aed0-b1eb-4076-a6db-001f435d5945 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.535938 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702aed0-b1eb-4076-a6db-001f435d5945 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.536881 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702aed0-b1eb-4076-a6db-001f435d5945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:14.537405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702aed0-b1eb-4076-a6db-001f435d5945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:14.539014 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702aed0-b1eb-4076-a6db-001f435d5945 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:14.554657 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 130/256] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:14.565893 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702aed0-b1eb-4076-a6db-001f435d5945 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:14.642539 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c60ab-758f-469c-b5c8-2920cf50c9db None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:14.728575 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888056e-a033-4b91-9497-813ff80815d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:14.729879 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888056e-a033-4b91-9497-813ff80815d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.730352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888056e-a033-4b91-9497-813ff80815d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.730814 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888056e-a033-4b91-9497-813ff80815d4 None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572/users/237cc770396b4b8e849026165b9913ff/roles/2099e2212de24144b089730e7db8ed3a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.732984 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888056e-a033-4b91-9497-813ff80815d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d96a406ef499477eb6b1ae5573304572, user_id=237cc770396b4b8e849026165b9913ff, role_id=2099e2212de24144b089730e7db8ed3a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:14.734681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888056e-a033-4b91-9497-813ff80815d4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:14.742573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702aed0-b1eb-4076-a6db-001f435d5945 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:14.774988 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 127/257] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:14 2022] PUT /identity/v3/projects/d96a406ef499477eb6b1ae5573304572/users/237cc770396b4b8e849026165b9913ff/roles/2099e2212de24144b089730e7db8ed3a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:52:14.776755 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92127dea-bd13-47b1-906b-2b77ba106c7b None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.777253 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92127dea-bd13-47b1-906b-2b77ba106c7b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.777744 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92127dea-bd13-47b1-906b-2b77ba106c7b None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.779330 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 128/258] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:14.784009 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecdf10-966e-4079-8d16-89b0b743e163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:14.785008 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecdf10-966e-4079-8d16-89b0b743e163 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.785330 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecdf10-966e-4079-8d16-89b0b743e163 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.785618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecdf10-966e-4079-8d16-89b0b743e163 None admin] PATH_INFO: `/v3/users/952d44da64ff4a0eb2ebed57174180d9` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.789969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecdf10-966e-4079-8d16-89b0b743e163 None admin] RBAC: Authorizing `identity:get_user(user_id=952d44da64ff4a0eb2ebed57174180d9)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:14.791026 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245fb06-fc3d-469c-8644-aeb7873080b7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.791580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245fb06-fc3d-469c-8644-aeb7873080b7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.791682 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecdf10-966e-4079-8d16-89b0b743e163 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:14.792177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245fb06-fc3d-469c-8644-aeb7873080b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.793946 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 131/259] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:14 2022] GET /identity/v3/users/952d44da64ff4a0eb2ebed57174180d9 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:14.799656 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecdf10-966e-4079-8d16-89b0b743e163 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:14.826245 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9245fb06-fc3d-469c-8644-aeb7873080b7 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:14.827790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9245fb06-fc3d-469c-8644-aeb7873080b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:14.851204 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:14.892018 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:14.960177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 129/260] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 24 00:52:14.965225 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecdf10-966e-4079-8d16-89b0b743e163 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.020874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cc3e5-9e0d-4f4b-9339-5d4c28a7a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.021579 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cc3e5-9e0d-4f4b-9339-5d4c28a7a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.021869 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cc3e5-9e0d-4f4b-9339-5d4c28a7a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.022146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cc3e5-9e0d-4f4b-9339-5d4c28a7a2a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.045251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245fb06-fc3d-469c-8644-aeb7873080b7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:15.135686 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cc3e5-9e0d-4f4b-9339-5d4c28a7a2a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:15.137323 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cc3e5-9e0d-4f4b-9339-5d4c28a7a2a5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:15.204837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:15.251530 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245fb06-fc3d-469c-8644-aeb7873080b7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.273849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 132/261] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:15.279766 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cc3e5-9e0d-4f4b-9339-5d4c28a7a2a5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:15.336839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bae6b-9d76-4d62-b739-de016be6bb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.342051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bae6b-9d76-4d62-b739-de016be6bb31 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.342492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bae6b-9d76-4d62-b739-de016be6bb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.342912 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bae6b-9d76-4d62-b739-de016be6bb31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.373271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bae6b-9d76-4d62-b739-de016be6bb31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-046bae6b-9d76-4d62-b739-de016be6bb31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:15.388161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:15.389291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:15.390231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:15.390231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:15.390231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:15.390231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:15.390231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:15.390231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:15.390231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:15.390231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:15.390231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:15.390231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:15.390231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:15.390231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:15.398782 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 130/262] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:15.404727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bae6b-9d76-4d62-b739-de016be6bb31 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:15.431368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:15.450273 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cc3e5-9e0d-4f4b-9339-5d4c28a7a2a5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.499680 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d405adb-3465-4ba5-9f7b-24102889c134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.500852 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d405adb-3465-4ba5-9f7b-24102889c134 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.501305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d405adb-3465-4ba5-9f7b-24102889c134 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.501777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d405adb-3465-4ba5-9f7b-24102889c134 None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.503906 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d405adb-3465-4ba5-9f7b-24102889c134 None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:15.506240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d405adb-3465-4ba5-9f7b-24102889c134 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:15.510517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 133/263] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:15.518818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d405adb-3465-4ba5-9f7b-24102889c134 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:15.552781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:15.608306 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bae6b-9d76-4d62-b739-de016be6bb31 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.675654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d405adb-3465-4ba5-9f7b-24102889c134 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.686622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84090446-a3a5-40d2-b386-f9986fac7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.687318 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84090446-a3a5-40d2-b386-f9986fac7e0c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.687599 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84090446-a3a5-40d2-b386-f9986fac7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.687877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84090446-a3a5-40d2-b386-f9986fac7e0c None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.688648 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84090446-a3a5-40d2-b386-f9986fac7e0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:15.688954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84090446-a3a5-40d2-b386-f9986fac7e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:15.690459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84090446-a3a5-40d2-b386-f9986fac7e0c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:15.710251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 131/264] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:15.717304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84090446-a3a5-40d2-b386-f9986fac7e0c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:15.771310 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996e08d-baf0-4c2e-ac26-1acdad9fbadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.771910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996e08d-baf0-4c2e-ac26-1acdad9fbadd None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.772190 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996e08d-baf0-4c2e-ac26-1acdad9fbadd None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.772463 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996e08d-baf0-4c2e-ac26-1acdad9fbadd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.773431 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996e08d-baf0-4c2e-ac26-1acdad9fbadd None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=d96a406ef499477eb6b1ae5573304572, user.id=952d44da64ff4a0eb2ebed57174180d9) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:15.773743 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996e08d-baf0-4c2e-ac26-1acdad9fbadd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:15.775225 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996e08d-baf0-4c2e-ac26-1acdad9fbadd None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:15.786171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 134/265] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/role_assignments?user.id=952d44da64ff4a0eb2ebed57174180d9&scope.project.id=d96a406ef499477eb6b1ae5573304572&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:15.840846 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61723557-21a7-4274-9c80-e0fb8dd4b6e7 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.841130 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61723557-21a7-4274-9c80-e0fb8dd4b6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.841428 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61723557-21a7-4274-9c80-e0fb8dd4b6e7 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.843126 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 135/266] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:15.849100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c1d3c-409b-46f5-b089-c7268257f4ca None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.849529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c1d3c-409b-46f5-b089-c7268257f4ca None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.849811 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c1d3c-409b-46f5-b089-c7268257f4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.863390 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:15.883238 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84090446-a3a5-40d2-b386-f9986fac7e0c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.889434 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6f3c1d3c-409b-46f5-b089-c7268257f4ca None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:15.890666 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6f3c1d3c-409b-46f5-b089-c7268257f4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:15.938583 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e72d0d-3e70-43d6-b5bc-1b7b7ef2ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.939502 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e72d0d-3e70-43d6-b5bc-1b7b7ef2ea17 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.939783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e72d0d-3e70-43d6-b5bc-1b7b7ef2ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.940090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e72d0d-3e70-43d6-b5bc-1b7b7ef2ea17 None admin] PATH_INFO: `/v3/users/952d44da64ff4a0eb2ebed57174180d9` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.946168 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e72d0d-3e70-43d6-b5bc-1b7b7ef2ea17 None admin] RBAC: Authorizing `identity:get_user(user_id=952d44da64ff4a0eb2ebed57174180d9)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:15.947679 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e72d0d-3e70-43d6-b5bc-1b7b7ef2ea17 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:15.949798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 132/267] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/users/952d44da64ff4a0eb2ebed57174180d9 => generated 283 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:15.957438 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e72d0d-3e70-43d6-b5bc-1b7b7ef2ea17 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.093499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 136/268] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:16.102574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e72d0d-3e70-43d6-b5bc-1b7b7ef2ea17 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.141708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa30034-48e5-45c5-aa64-3135cd3a8869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:16.142376 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa30034-48e5-45c5-aa64-3135cd3a8869 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.142661 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa30034-48e5-45c5-aa64-3135cd3a8869 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.142940 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa30034-48e5-45c5-aa64-3135cd3a8869 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.158580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:16.166951 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c1d3c-409b-46f5-b089-c7268257f4ca None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.208559 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:16.274744 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa30034-48e5-45c5-aa64-3135cd3a8869 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:16.276247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa30034-48e5-45c5-aa64-3135cd3a8869 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:16.325100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c1d3c-409b-46f5-b089-c7268257f4ca None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.363445 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a36f80-daf9-41b9-893b-fb952c87953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:16.365193 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a36f80-daf9-41b9-893b-fb952c87953c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.365828 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a36f80-daf9-41b9-893b-fb952c87953c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.366312 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a36f80-daf9-41b9-893b-fb952c87953c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.381404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a36f80-daf9-41b9-893b-fb952c87953c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:16.389456 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 133/269] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-73a36f80-daf9-41b9-893b-fb952c87953c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:16.389977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:16.391052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:16.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:16.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:16.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:16.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:16.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:16.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:16.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:16.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:16.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:16.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:16.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:16.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:16.392668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 137/270] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:16.394370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffefc6-6d1c-4c75-8bce-47ddb1c25a99 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.394370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffefc6-6d1c-4c75-8bce-47ddb1c25a99 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.394539 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffefc6-6d1c-4c75-8bce-47ddb1c25a99 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.395981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 134/271] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:16.401794 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bd91b-0c6a-4ae0-9339-3a786c39a55e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.401936 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffefc6-6d1c-4c75-8bce-47ddb1c25a99 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.402410 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bd91b-0c6a-4ae0-9339-3a786c39a55e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.402897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bd91b-0c6a-4ae0-9339-3a786c39a55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.424976 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-bd2bd91b-0c6a-4ae0-9339-3a786c39a55e None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:16.426334 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bd2bd91b-0c6a-4ae0-9339-3a786c39a55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:16.453759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:16.505910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 138/272] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:16.517404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bd91b-0c6a-4ae0-9339-3a786c39a55e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.527223 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffefc6-6d1c-4c75-8bce-47ddb1c25a99 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.533351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:16.566948 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77e376-3c1a-44e3-af48-e96f04ba6a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:16.568034 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77e376-3c1a-44e3-af48-e96f04ba6a8a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.568376 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77e376-3c1a-44e3-af48-e96f04ba6a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.568739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77e376-3c1a-44e3-af48-e96f04ba6a8a None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.572648 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77e376-3c1a-44e3-af48-e96f04ba6a8a None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:16.574237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77e376-3c1a-44e3-af48-e96f04ba6a8a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:16.576382 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 135/273] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:16 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:16.577701 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08604eca-6f81-472c-b8bd-6da1e3bec484 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.578052 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08604eca-6f81-472c-b8bd-6da1e3bec484 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.578396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08604eca-6f81-472c-b8bd-6da1e3bec484 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.580429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 136/274] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:16.581386 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08604eca-6f81-472c-b8bd-6da1e3bec484 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.639107 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bd91b-0c6a-4ae0-9339-3a786c39a55e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.678288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a178ce-f2f9-4bfa-9354-8ab2d5fb4dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:16.679209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a178ce-f2f9-4bfa-9354-8ab2d5fb4dad None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.679737 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a178ce-f2f9-4bfa-9354-8ab2d5fb4dad None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.680018 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a178ce-f2f9-4bfa-9354-8ab2d5fb4dad None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a178ce-f2f9-4bfa-9354-8ab2d5fb4dad None admin] RBAC: Adding query filter params (name=member) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:16.681062 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a178ce-f2f9-4bfa-9354-8ab2d5fb4dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:16.682639 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a178ce-f2f9-4bfa-9354-8ab2d5fb4dad None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:16.691851 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 139/275] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:16.692519 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a178ce-f2f9-4bfa-9354-8ab2d5fb4dad None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.694565 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08604eca-6f81-472c-b8bd-6da1e3bec484 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.704631 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:16.738189 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e8a70-cc85-4ffd-9d67-2e543e40443e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:16.739000 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e8a70-cc85-4ffd-9d67-2e543e40443e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.739279 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e8a70-cc85-4ffd-9d67-2e543e40443e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.739556 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e8a70-cc85-4ffd-9d67-2e543e40443e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.740736 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e8a70-cc85-4ffd-9d67-2e543e40443e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:16.742274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e8a70-cc85-4ffd-9d67-2e543e40443e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:16.744104 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 137/276] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:16.746989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3685c-9835-4b67-89db-c89c02c7911b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.747733 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3685c-9835-4b67-89db-c89c02c7911b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.748340 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3685c-9835-4b67-89db-c89c02c7911b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.768127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-78c3685c-9835-4b67-89db-c89c02c7911b None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:16.769594 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-78c3685c-9835-4b67-89db-c89c02c7911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:16.770950 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:16.794806 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a178ce-f2f9-4bfa-9354-8ab2d5fb4dad None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.830031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa0c4f-dd31-4e3b-802c-9310486f846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:16.831012 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa0c4f-dd31-4e3b-802c-9310486f846e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.831313 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa0c4f-dd31-4e3b-802c-9310486f846e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.831739 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa0c4f-dd31-4e3b-802c-9310486f846e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.832988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa0c4f-dd31-4e3b-802c-9310486f846e None admin] RBAC: Adding query filter params (role.id=d91e55b589bd4b9aaab2ab607f087f8d, scope.project.id=d96a406ef499477eb6b1ae5573304572, user.id=952d44da64ff4a0eb2ebed57174180d9) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:16.833241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa0c4f-dd31-4e3b-802c-9310486f846e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:16.834674 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa0c4f-dd31-4e3b-802c-9310486f846e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:16.840868 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 140/277] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:16 2022] GET /identity/v3/role_assignments?user.id=952d44da64ff4a0eb2ebed57174180d9&scope.project.id=d96a406ef499477eb6b1ae5573304572&role.id=d91e55b589bd4b9aaab2ab607f087f8d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:16.841834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa0c4f-dd31-4e3b-802c-9310486f846e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.842136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 138/278] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:16.842982 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3685c-9835-4b67-89db-c89c02c7911b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.979667 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa0c4f-dd31-4e3b-802c-9310486f846e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.984228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3685c-9835-4b67-89db-c89c02c7911b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.987168 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:17.025501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661d9e6-e92d-4737-afc0-c2d13e5a6d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.026119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d144d-148e-40bc-a973-4957e7aa6c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.026766 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661d9e6-e92d-4737-afc0-c2d13e5a6d5a None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.027005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d144d-148e-40bc-a973-4957e7aa6c2a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.027284 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d144d-148e-40bc-a973-4957e7aa6c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.027554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d144d-148e-40bc-a973-4957e7aa6c2a None admin] PATH_INFO: `/v3/users/8a40114b1eff4fc2b34a585e1e8034a8` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.027759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661d9e6-e92d-4737-afc0-c2d13e5a6d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.028209 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661d9e6-e92d-4737-afc0-c2d13e5a6d5a None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.028946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661d9e6-e92d-4737-afc0-c2d13e5a6d5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:17.030509 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661d9e6-e92d-4737-afc0-c2d13e5a6d5a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:17.040727 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:17.045443 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d144d-148e-40bc-a973-4957e7aa6c2a None admin] RBAC: Authorizing `identity:get_user(user_id=8a40114b1eff4fc2b34a585e1e8034a8)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:17.047021 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d144d-148e-40bc-a973-4957e7aa6c2a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:17.053760 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 141/279] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:16 2022] GET /identity/v3/users/8a40114b1eff4fc2b34a585e1e8034a8 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:17.054678 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d144d-148e-40bc-a973-4957e7aa6c2a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:17.058313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 139/280] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:16 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:17.060013 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661d9e6-e92d-4737-afc0-c2d13e5a6d5a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:17.171614 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d144d-148e-40bc-a973-4957e7aa6c2a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:17.198419 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661d9e6-e92d-4737-afc0-c2d13e5a6d5a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:17.219030 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291ee0f-e818-426c-882d-b11ade4eedb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.220677 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291ee0f-e818-426c-882d-b11ade4eedb9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.221569 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291ee0f-e818-426c-882d-b11ade4eedb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.222062 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291ee0f-e818-426c-882d-b11ade4eedb9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.239555 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291ee0f-e818-426c-882d-b11ade4eedb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:17.249128 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e646a-a1a5-4bef-bea1-2509f63e6af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.249908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e646a-a1a5-4bef-bea1-2509f63e6af8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-d291ee0f-e818-426c-882d-b11ade4eedb9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:17.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:17.251373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:17.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:17.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:17.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:17.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:17.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:17.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:17.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:17.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:17.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:17.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:17.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:17.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:17.252908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e646a-a1a5-4bef-bea1-2509f63e6af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.252908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e646a-a1a5-4bef-bea1-2509f63e6af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.252908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e646a-a1a5-4bef-bea1-2509f63e6af8 None admin] RBAC: Adding query filter params (role.id=2099e2212de24144b089730e7db8ed3a, user.id=8a40114b1eff4fc2b34a585e1e8034a8, scope.system=all) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:17.252908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e646a-a1a5-4bef-bea1-2509f63e6af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:17.253139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e646a-a1a5-4bef-bea1-2509f63e6af8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:17.254795 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 142/281] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:17.262270 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291ee0f-e818-426c-882d-b11ade4eedb9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:17.265406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 140/282] 10.222.0.43 () {56 vars in 1308 bytes} [Sun Jul 24 00:52:17 2022] GET /identity/v3/role_assignments?user.id=8a40114b1eff4fc2b34a585e1e8034a8&scope.system=all&role.id=2099e2212de24144b089730e7db8ed3a => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:17.333457 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:17.384917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291ee0f-e818-426c-882d-b11ade4eedb9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:17.426786 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d12bd-da95-4b98-a307-aa5e0cf6b5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.427793 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d12bd-da95-4b98-a307-aa5e0cf6b5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.428085 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d12bd-da95-4b98-a307-aa5e0cf6b5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.428364 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d12bd-da95-4b98-a307-aa5e0cf6b5f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.429132 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d12bd-da95-4b98-a307-aa5e0cf6b5f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:17.429558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d12bd-da95-4b98-a307-aa5e0cf6b5f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:17.430897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d12bd-da95-4b98-a307-aa5e0cf6b5f4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:17.441733 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 143/283] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:17.448013 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e646a-a1a5-4bef-bea1-2509f63e6af8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:17.483636 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:17.486164 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268a2ed-381a-44d1-9c00-f21a57ba9a5f None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.486463 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268a2ed-381a-44d1-9c00-f21a57ba9a5f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.486903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268a2ed-381a-44d1-9c00-f21a57ba9a5f None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.488885 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 144/284] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:17.494636 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf5ad0-86a7-4bfc-a6ff-e052021b3491 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.494864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf5ad0-86a7-4bfc-a6ff-e052021b3491 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.495116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf5ad0-86a7-4bfc-a6ff-e052021b3491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.518312 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-1eaf5ad0-86a7-4bfc-a6ff-e052021b3491 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:17.519874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1eaf5ad0-86a7-4bfc-a6ff-e052021b3491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:17.585383 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e646a-a1a5-4bef-bea1-2509f63e6af8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:17.611630 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 145/285] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:17.635945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf5ad0-86a7-4bfc-a6ff-e052021b3491 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:17.636374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f9afb-f61b-4e87-b938-e777303a082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.637302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9afb-f61b-4e87-b938-e777303a082a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.637698 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9afb-f61b-4e87-b938-e777303a082a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.637977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f9afb-f61b-4e87-b938-e777303a082a None admin] PATH_INFO: `/v3/users/a1549d38660b44a5afde78347aff4a9a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.641971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f9afb-f61b-4e87-b938-e777303a082a None admin] RBAC: Authorizing `identity:get_user(user_id=a1549d38660b44a5afde78347aff4a9a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:17.646347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f9afb-f61b-4e87-b938-e777303a082a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:17.651441 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 141/286] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:17 2022] GET /identity/v3/users/a1549d38660b44a5afde78347aff4a9a => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:17.654317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f9afb-f61b-4e87-b938-e777303a082a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:17.721626 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:17.807322 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf5ad0-86a7-4bfc-a6ff-e052021b3491 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:17.834331 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:17.854282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f9afb-f61b-4e87-b938-e777303a082a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:17.865981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203728a-738c-48c3-9d8f-9af44cedd97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.865981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203728a-738c-48c3-9d8f-9af44cedd97e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.865981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203728a-738c-48c3-9d8f-9af44cedd97e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.865981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203728a-738c-48c3-9d8f-9af44cedd97e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.890302 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203728a-738c-48c3-9d8f-9af44cedd97e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-f203728a-738c-48c3-9d8f-9af44cedd97e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:17.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:17.900901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:17.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:17.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:17.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:17.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:17.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:17.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:17.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:17.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:17.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:17.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:17.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:17.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:17.906264 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 146/287] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:17.912169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203728a-738c-48c3-9d8f-9af44cedd97e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:17.942529 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afe1ea-4dc4-40d2-9c94-54b7f051946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.943542 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe1ea-4dc4-40d2-9c94-54b7f051946f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.943721 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe1ea-4dc4-40d2-9c94-54b7f051946f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.943984 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe1ea-4dc4-40d2-9c94-54b7f051946f None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.945191 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afe1ea-4dc4-40d2-9c94-54b7f051946f None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:17.946694 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afe1ea-4dc4-40d2-9c94-54b7f051946f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:17.948441 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 142/288] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:17 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:17.954338 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afe1ea-4dc4-40d2-9c94-54b7f051946f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:18.021562 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203728a-738c-48c3-9d8f-9af44cedd97e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:18.032995 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:18.065269 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c28f4b-3db2-4527-9d51-e26021f8ef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:18.066316 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c28f4b-3db2-4527-9d51-e26021f8ef22 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.066792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c28f4b-3db2-4527-9d51-e26021f8ef22 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.067280 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c28f4b-3db2-4527-9d51-e26021f8ef22 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.068368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c28f4b-3db2-4527-9d51-e26021f8ef22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:18.069715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c28f4b-3db2-4527-9d51-e26021f8ef22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:18.072611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c28f4b-3db2-4527-9d51-e26021f8ef22 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:18.089415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 147/289] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:18.095462 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c28f4b-3db2-4527-9d51-e26021f8ef22 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:18.201002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afe1ea-4dc4-40d2-9c94-54b7f051946f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:18.202306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c28f4b-3db2-4527-9d51-e26021f8ef22 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:18.238409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c5c5d-b6c0-4f50-8dbd-a5e785611e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:18.239682 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5c5d-b6c0-4f50-8dbd-a5e785611e8a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.240226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5c5d-b6c0-4f50-8dbd-a5e785611e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.240813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5c5d-b6c0-4f50-8dbd-a5e785611e8a None admin] PATH_INFO: `/v3/users/237cc770396b4b8e849026165b9913ff` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.242115 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5c5d-b6c0-4f50-8dbd-a5e785611e8a None admin] RBAC: Authorizing `identity:get_user(user_id=237cc770396b4b8e849026165b9913ff)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:18.243776 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5c5d-b6c0-4f50-8dbd-a5e785611e8a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:18.245825 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 148/290] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:18 2022] GET /identity/v3/users/237cc770396b4b8e849026165b9913ff => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:18.251436 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c5c5d-b6c0-4f50-8dbd-a5e785611e8a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:18.255947 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63f614-80d8-4865-893a-785cc1d67209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:18.257066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63f614-80d8-4865-893a-785cc1d67209 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.257541 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63f614-80d8-4865-893a-785cc1d67209 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.258005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63f614-80d8-4865-893a-785cc1d67209 None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572/users/a1549d38660b44a5afde78347aff4a9a/roles/56edef813db54c3c826f9af018142f20` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.260161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63f614-80d8-4865-893a-785cc1d67209 None admin] RBAC: Authorizing `identity:create_grant(project_id=d96a406ef499477eb6b1ae5573304572, user_id=a1549d38660b44a5afde78347aff4a9a, role_id=56edef813db54c3c826f9af018142f20)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:18.261827 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63f614-80d8-4865-893a-785cc1d67209 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:18.280749 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 143/291] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:17 2022] PUT /identity/v3/projects/d96a406ef499477eb6b1ae5573304572/users/a1549d38660b44a5afde78347aff4a9a/roles/56edef813db54c3c826f9af018142f20 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:52:18.309566 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:18.373315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c5c5d-b6c0-4f50-8dbd-a5e785611e8a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:18.410849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8792a-d40d-4d0d-b84a-db37b7c6c8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:18.411908 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8792a-d40d-4d0d-b84a-db37b7c6c8fc None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.412388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8792a-d40d-4d0d-b84a-db37b7c6c8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.412858 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8792a-d40d-4d0d-b84a-db37b7c6c8fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.485195 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8792a-d40d-4d0d-b84a-db37b7c6c8fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:18.487155 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8792a-d40d-4d0d-b84a-db37b7c6c8fc None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:18.530944 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:18.597249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 149/292] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:52:18.601688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63f614-80d8-4865-893a-785cc1d67209 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:18.625483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:18.723949 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63f614-80d8-4865-893a-785cc1d67209 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:18.766800 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7a53e-8a78-42f8-8356-4057ede69b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:18.767685 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7a53e-8a78-42f8-8356-4057ede69b6f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.767965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7a53e-8a78-42f8-8356-4057ede69b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.768236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7a53e-8a78-42f8-8356-4057ede69b6f None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.769551 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7a53e-8a78-42f8-8356-4057ede69b6f None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:18.771020 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7a53e-8a78-42f8-8356-4057ede69b6f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:18.772871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 144/293] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:18 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:18.779117 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8792a-d40d-4d0d-b84a-db37b7c6c8fc None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:18.923866 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8792a-d40d-4d0d-b84a-db37b7c6c8fc None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:18.966117 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7657fc-e027-4175-9888-cb4d7551b443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:18.966781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7657fc-e027-4175-9888-cb4d7551b443 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.967066 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7657fc-e027-4175-9888-cb4d7551b443 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.967340 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7657fc-e027-4175-9888-cb4d7551b443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.968181 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7657fc-e027-4175-9888-cb4d7551b443 None admin] RBAC: Adding query filter params (role.id=2099e2212de24144b089730e7db8ed3a, scope.project.id=d96a406ef499477eb6b1ae5573304572, user.id=237cc770396b4b8e849026165b9913ff) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:18.968489 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7657fc-e027-4175-9888-cb4d7551b443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:18.970105 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7657fc-e027-4175-9888-cb4d7551b443 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:18.976361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 150/294] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:18 2022] GET /identity/v3/role_assignments?user.id=237cc770396b4b8e849026165b9913ff&scope.project.id=d96a406ef499477eb6b1ae5573304572&role.id=2099e2212de24144b089730e7db8ed3a => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:19.582023 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c48f-9f1e-459b-b6cd-e3fc649b4e8a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.582396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c48f-9f1e-459b-b6cd-e3fc649b4e8a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.582587 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c48f-9f1e-459b-b6cd-e3fc649b4e8a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.584279 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 145/295] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:19.589896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a87c66-bddf-4fc6-a39b-9cf75fd84307 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.590186 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a87c66-bddf-4fc6-a39b-9cf75fd84307 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.590459 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a87c66-bddf-4fc6-a39b-9cf75fd84307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.599342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:19.613056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-17a87c66-bddf-4fc6-a39b-9cf75fd84307 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:19.614650 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-17a87c66-bddf-4fc6-a39b-9cf75fd84307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:19.698824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 151/296] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:19.721751 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27c48f-9f1e-459b-b6cd-e3fc649b4e8a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:19.729931 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117626b-fd28-4dc6-a755-75a7e0a45d2f None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.730240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117626b-fd28-4dc6-a755-75a7e0a45d2f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.730495 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117626b-fd28-4dc6-a755-75a7e0a45d2f None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.732128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 152/297] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:19.737092 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fed283-9cf4-4184-89c5-7e12ee7c0c2c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.737484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fed283-9cf4-4184-89c5-7e12ee7c0c2c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.737775 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fed283-9cf4-4184-89c5-7e12ee7c0c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.755262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e2fed283-9cf4-4184-89c5-7e12ee7c0c2c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:19.756572 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e2fed283-9cf4-4184-89c5-7e12ee7c0c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:19.831853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:19.832913 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 153/298] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:19.834251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad59976-65b6-4359-8747-51b4cc31b5fa None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.834358 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad59976-65b6-4359-8747-51b4cc31b5fa None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.834575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad59976-65b6-4359-8747-51b4cc31b5fa None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.835928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 154/299] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:19.841581 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7c455-4316-49d4-987c-77d95e8379ab None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.841860 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7c455-4316-49d4-987c-77d95e8379ab None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.842136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7c455-4316-49d4-987c-77d95e8379ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.852863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27c48f-9f1e-459b-b6cd-e3fc649b4e8a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:19.860833 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2ff7c455-4316-49d4-987c-77d95e8379ab None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:19.862158 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2ff7c455-4316-49d4-987c-77d95e8379ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:19.889868 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba044ca0-032d-47fc-9e04-1052079dea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:19.890672 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba044ca0-032d-47fc-9e04-1052079dea0d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.890954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba044ca0-032d-47fc-9e04-1052079dea0d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.891222 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba044ca0-032d-47fc-9e04-1052079dea0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.905238 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba044ca0-032d-47fc-9e04-1052079dea0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ba044ca0-032d-47fc-9e04-1052079dea0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:19.909352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:19.910212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:19.911464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 146/300] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:19.912371 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba044ca0-032d-47fc-9e04-1052079dea0d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:19.930369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:19.941247 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 155/301] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:19.941247 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7c455-4316-49d4-987c-77d95e8379ab None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.028362 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba044ca0-032d-47fc-9e04-1052079dea0d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.045194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7c455-4316-49d4-987c-77d95e8379ab None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.060593 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba27af-6f87-4366-8467-66757ff2340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.061420 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba27af-6f87-4366-8467-66757ff2340c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.061699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba27af-6f87-4366-8467-66757ff2340c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.061966 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba27af-6f87-4366-8467-66757ff2340c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.063125 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba27af-6f87-4366-8467-66757ff2340c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:20.064572 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba27af-6f87-4366-8467-66757ff2340c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:20.066272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 147/302] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:20.067021 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba27af-6f87-4366-8467-66757ff2340c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.085568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:20.085771 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd64bc1-7cf7-4f20-8d79-9f43b221627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.086951 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd64bc1-7cf7-4f20-8d79-9f43b221627f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.087370 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd64bc1-7cf7-4f20-8d79-9f43b221627f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.087798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd64bc1-7cf7-4f20-8d79-9f43b221627f None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.089099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd64bc1-7cf7-4f20-8d79-9f43b221627f None admin] RBAC: Adding query filter params (name=member) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:20.089561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd64bc1-7cf7-4f20-8d79-9f43b221627f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:20.091091 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd64bc1-7cf7-4f20-8d79-9f43b221627f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:20.099541 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 156/303] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:20.100302 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd64bc1-7cf7-4f20-8d79-9f43b221627f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.158179 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:20.171577 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba27af-6f87-4366-8467-66757ff2340c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.206205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd64bc1-7cf7-4f20-8d79-9f43b221627f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.206509 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740da4c-77b3-4426-82d1-0b41f9d81822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.207748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740da4c-77b3-4426-82d1-0b41f9d81822 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.208049 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740da4c-77b3-4426-82d1-0b41f9d81822 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.208448 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740da4c-77b3-4426-82d1-0b41f9d81822 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.219268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740da4c-77b3-4426-82d1-0b41f9d81822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c740da4c-77b3-4426-82d1-0b41f9d81822 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:20.227016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:20.227902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:20.228718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 148/304] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:20.229393 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740da4c-77b3-4426-82d1-0b41f9d81822 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.247358 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0edef-f38f-43f0-aa20-feaa56ae5c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.248035 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0edef-f38f-43f0-aa20-feaa56ae5c09 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.248290 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0edef-f38f-43f0-aa20-feaa56ae5c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.248592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0edef-f38f-43f0-aa20-feaa56ae5c09 None admin] PATH_INFO: `/v3/groups` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.249344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0edef-f38f-43f0-aa20-feaa56ae5c09 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:20.250842 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0edef-f38f-43f0-aa20-feaa56ae5c09 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:20.273240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 157/305] 10.222.0.43 () {60 vars in 1134 bytes} [Sun Jul 24 00:52:20 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:20.273240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0edef-f38f-43f0-aa20-feaa56ae5c09 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.318950 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:20.353123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740da4c-77b3-4426-82d1-0b41f9d81822 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.400670 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0edef-f38f-43f0-aa20-feaa56ae5c09 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.406567 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25b5db-f1c3-42ae-bfbc-81551b17a598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.407825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25b5db-f1c3-42ae-bfbc-81551b17a598 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.408333 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25b5db-f1c3-42ae-bfbc-81551b17a598 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.409519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25b5db-f1c3-42ae-bfbc-81551b17a598 None admin] PATH_INFO: `/v3/users/8a40114b1eff4fc2b34a585e1e8034a8` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.411597 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25b5db-f1c3-42ae-bfbc-81551b17a598 None admin] RBAC: Authorizing `identity:get_user(user_id=8a40114b1eff4fc2b34a585e1e8034a8)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:20.414149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25b5db-f1c3-42ae-bfbc-81551b17a598 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:20.417032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 149/306] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:20 2022] GET /identity/v3/users/8a40114b1eff4fc2b34a585e1e8034a8 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:20.419664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:20.429261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25b5db-f1c3-42ae-bfbc-81551b17a598 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.448921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be592247-07b6-460d-a03e-ed4b86d21532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.450054 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be592247-07b6-460d-a03e-ed4b86d21532 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.450427 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be592247-07b6-460d-a03e-ed4b86d21532 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.450708 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be592247-07b6-460d-a03e-ed4b86d21532 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.451586 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be592247-07b6-460d-a03e-ed4b86d21532 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:20.451887 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be592247-07b6-460d-a03e-ed4b86d21532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:20.453345 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be592247-07b6-460d-a03e-ed4b86d21532 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:20.464329 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 158/307] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:20.470401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be592247-07b6-460d-a03e-ed4b86d21532 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.547501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25b5db-f1c3-42ae-bfbc-81551b17a598 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.593590 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0876a8-09e5-4380-858d-6f5c58bf1727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.594606 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0876a8-09e5-4380-858d-6f5c58bf1727 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.594950 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0876a8-09e5-4380-858d-6f5c58bf1727 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.595291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0876a8-09e5-4380-858d-6f5c58bf1727 None admin] PATH_INFO: `/v3/system/users/8a40114b1eff4fc2b34a585e1e8034a8/roles/2099e2212de24144b089730e7db8ed3a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.597111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0876a8-09e5-4380-858d-6f5c58bf1727 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8a40114b1eff4fc2b34a585e1e8034a8, role_id=2099e2212de24144b089730e7db8ed3a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:20.598516 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0876a8-09e5-4380-858d-6f5c58bf1727 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:20.600423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be592247-07b6-460d-a03e-ed4b86d21532 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.611896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 150/308] 10.222.0.43 () {58 vars in 1334 bytes} [Sun Jul 24 00:52:20 2022] PUT /identity/v3/system/users/8a40114b1eff4fc2b34a585e1e8034a8/roles/2099e2212de24144b089730e7db8ed3a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:52:20.639000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a9cac-a278-49e8-ad25-8364c5bbe52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.640315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a9cac-a278-49e8-ad25-8364c5bbe52d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.640797 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a9cac-a278-49e8-ad25-8364c5bbe52d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.641328 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a9cac-a278-49e8-ad25-8364c5bbe52d None admin] PATH_INFO: `/v3/users/51759863324d40309845a811897db967` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.661242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a9cac-a278-49e8-ad25-8364c5bbe52d None admin] RBAC: Authorizing `identity:get_user(user_id=51759863324d40309845a811897db967)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:20.663089 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a9cac-a278-49e8-ad25-8364c5bbe52d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:20.665456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 159/309] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:20 2022] GET /identity/v3/users/51759863324d40309845a811897db967 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:20.674639 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0876a8-09e5-4380-858d-6f5c58bf1727 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.687160 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:20.768480 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa4427-91a5-45ed-8556-305063047dd3 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.768888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa4427-91a5-45ed-8556-305063047dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.769109 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa4427-91a5-45ed-8556-305063047dd3 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.770810 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 160/310] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:20.776455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70414b4c-46af-423e-a6b9-31c25f098d10 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.776751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70414b4c-46af-423e-a6b9-31c25f098d10 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.777012 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70414b4c-46af-423e-a6b9-31c25f098d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.794640 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-70414b4c-46af-423e-a6b9-31c25f098d10 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:20.795871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-70414b4c-46af-423e-a6b9-31c25f098d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:20.800852 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0876a8-09e5-4380-858d-6f5c58bf1727 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.831010 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:20.852231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeed95-a6e8-4812-b1f9-48d2de837a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.852904 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeed95-a6e8-4812-b1f9-48d2de837a7b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.853193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeed95-a6e8-4812-b1f9-48d2de837a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.853508 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeed95-a6e8-4812-b1f9-48d2de837a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.854995 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eeed95-a6e8-4812-b1f9-48d2de837a7b None admin] RBAC: Adding query filter params (role.id=56edef813db54c3c826f9af018142f20, user.id=51759863324d40309845a811897db967, scope.system=all) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:20.855314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eeed95-a6e8-4812-b1f9-48d2de837a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:20.856953 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eeed95-a6e8-4812-b1f9-48d2de837a7b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:20.863923 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 151/311] 10.222.0.43 () {56 vars in 1308 bytes} [Sun Jul 24 00:52:20 2022] GET /identity/v3/role_assignments?user.id=51759863324d40309845a811897db967&scope.system=all&role.id=56edef813db54c3c826f9af018142f20 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:20.885220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 161/312] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:20.909377 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeed95-a6e8-4812-b1f9-48d2de837a7b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.991760 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:21.026016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eeed95-a6e8-4812-b1f9-48d2de837a7b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:21.061442 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee71625-d452-4514-99ff-49dd48e63b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:21.062263 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee71625-d452-4514-99ff-49dd48e63b33 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.062547 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee71625-d452-4514-99ff-49dd48e63b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.062838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee71625-d452-4514-99ff-49dd48e63b33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.074398 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee71625-d452-4514-99ff-49dd48e63b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-8ee71625-d452-4514-99ff-49dd48e63b33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:21.082410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:21.083319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:21.084094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 152/313] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:21.090399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70414b4c-46af-423e-a6b9-31c25f098d10 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:21.194289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70414b4c-46af-423e-a6b9-31c25f098d10 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:21.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086cfdc-6fc2-4082-86eb-0ad40b20aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:21.231140 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086cfdc-6fc2-4082-86eb-0ad40b20aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.231426 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086cfdc-6fc2-4082-86eb-0ad40b20aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.231702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086cfdc-6fc2-4082-86eb-0ad40b20aeb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.232463 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086cfdc-6fc2-4082-86eb-0ad40b20aeb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:21.232767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086cfdc-6fc2-4082-86eb-0ad40b20aeb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:21.234196 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086cfdc-6fc2-4082-86eb-0ad40b20aeb4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:21.243098 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 162/314] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:21.248761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee71625-d452-4514-99ff-49dd48e63b33 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:21.357302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee71625-d452-4514-99ff-49dd48e63b33 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:21.387816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:21.393287 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9612fd-ca7c-4de8-af5c-2a1348be5c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:21.394398 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9612fd-ca7c-4de8-af5c-2a1348be5c0e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.394677 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9612fd-ca7c-4de8-af5c-2a1348be5c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.394947 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9612fd-ca7c-4de8-af5c-2a1348be5c0e None admin] PATH_INFO: `/v3/users/a1549d38660b44a5afde78347aff4a9a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.396151 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9612fd-ca7c-4de8-af5c-2a1348be5c0e None admin] RBAC: Authorizing `identity:get_user(user_id=a1549d38660b44a5afde78347aff4a9a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:21.397636 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9612fd-ca7c-4de8-af5c-2a1348be5c0e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:21.399633 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 153/315] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:21 2022] GET /identity/v3/users/a1549d38660b44a5afde78347aff4a9a => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:21.404855 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086cfdc-6fc2-4082-86eb-0ad40b20aeb4 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:21.436430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:21.514959 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086cfdc-6fc2-4082-86eb-0ad40b20aeb4 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:21.549951 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703b226-20c5-4cf9-b25a-811f3f620716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:21.550618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703b226-20c5-4cf9-b25a-811f3f620716 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.550903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703b226-20c5-4cf9-b25a-811f3f620716 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.551183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703b226-20c5-4cf9-b25a-811f3f620716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.621732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703b226-20c5-4cf9-b25a-811f3f620716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:21.623199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703b226-20c5-4cf9-b25a-811f3f620716 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:21.650796 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:21.728318 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 163/316] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:21.734308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9612fd-ca7c-4de8-af5c-2a1348be5c0e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:21.839654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9612fd-ca7c-4de8-af5c-2a1348be5c0e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:21.879458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac85c0f-456a-4540-ab4a-a4266ea245cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:21.880719 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac85c0f-456a-4540-ab4a-a4266ea245cf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac85c0f-456a-4540-ab4a-a4266ea245cf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.881727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac85c0f-456a-4540-ab4a-a4266ea245cf None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.883207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac85c0f-456a-4540-ab4a-a4266ea245cf None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:21.884854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac85c0f-456a-4540-ab4a-a4266ea245cf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:21.887118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 154/317] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:21 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:21.897254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703b226-20c5-4cf9-b25a-811f3f620716 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:21.996328 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703b226-20c5-4cf9-b25a-811f3f620716 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:22.026105 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:22.034570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4dce5-febf-43c8-9f16-956cc79a0ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:22.035247 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4dce5-febf-43c8-9f16-956cc79a0ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.035534 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4dce5-febf-43c8-9f16-956cc79a0ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.035825 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4dce5-febf-43c8-9f16-956cc79a0ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.036912 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4dce5-febf-43c8-9f16-956cc79a0ea8 None admin] RBAC: Adding query filter params (role.id=56edef813db54c3c826f9af018142f20, scope.project.id=d96a406ef499477eb6b1ae5573304572, user.id=a1549d38660b44a5afde78347aff4a9a) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:22.037256 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4dce5-febf-43c8-9f16-956cc79a0ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:22.038846 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4dce5-febf-43c8-9f16-956cc79a0ea8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:22.045417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 164/318] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:21 2022] GET /identity/v3/role_assignments?user.id=a1549d38660b44a5afde78347aff4a9a&scope.project.id=d96a406ef499477eb6b1ae5573304572&role.id=56edef813db54c3c826f9af018142f20 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:22.406812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2a97-4f94-487d-a6ad-5663064fcb67 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.407246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2a97-4f94-487d-a6ad-5663064fcb67 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.407346 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2a97-4f94-487d-a6ad-5663064fcb67 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.408919 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 155/319] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:22.414094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7026a8-d816-44fa-b67b-acca7ed8b690 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.414370 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7026a8-d816-44fa-b67b-acca7ed8b690 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.414672 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7026a8-d816-44fa-b67b-acca7ed8b690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.431826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-cd7026a8-d816-44fa-b67b-acca7ed8b690 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:22.433020 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-cd7026a8-d816-44fa-b67b-acca7ed8b690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:22.504913 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 165/320] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:22.527544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc2a97-4f94-487d-a6ad-5663064fcb67 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:22.604723 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:22.641364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc2a97-4f94-487d-a6ad-5663064fcb67 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:22.675325 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4e81d-33c8-4f6c-ac72-1ac71db69d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:22.676050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4e81d-33c8-4f6c-ac72-1ac71db69d31 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.676329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4e81d-33c8-4f6c-ac72-1ac71db69d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.676601 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4e81d-33c8-4f6c-ac72-1ac71db69d31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.677812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4e81d-33c8-4f6c-ac72-1ac71db69d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:22.679274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4e81d-33c8-4f6c-ac72-1ac71db69d31 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:22.681079 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 156/321] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:22.686562 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7026a8-d816-44fa-b67b-acca7ed8b690 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:22.767255 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96c79-09e3-4bef-a807-5f09512a984f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.767515 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96c79-09e3-4bef-a807-5f09512a984f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.768014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96c79-09e3-4bef-a807-5f09512a984f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.770021 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 157/322] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:22.778357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90ec76-f0e8-4708-8c59-e8379fa4a7e4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.778644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90ec76-f0e8-4708-8c59-e8379fa4a7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.778920 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90ec76-f0e8-4708-8c59-e8379fa4a7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.794101 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7026a8-d816-44fa-b67b-acca7ed8b690 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:22.801681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-da90ec76-f0e8-4708-8c59-e8379fa4a7e4 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:22.803013 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-da90ec76-f0e8-4708-8c59-e8379fa4a7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:22.819375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:22.832735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb86144-44fb-41a2-9b19-36196a05c2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:22.833469 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb86144-44fb-41a2-9b19-36196a05c2ee None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.833713 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb86144-44fb-41a2-9b19-36196a05c2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.833978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb86144-44fb-41a2-9b19-36196a05c2ee None admin] PATH_INFO: `/v3/groups` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.834668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb86144-44fb-41a2-9b19-36196a05c2ee None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:22.836130 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb86144-44fb-41a2-9b19-36196a05c2ee None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:22.851679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 166/323] 10.222.0.43 () {60 vars in 1134 bytes} [Sun Jul 24 00:52:22 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:22.878187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 158/324] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:22.902045 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb86144-44fb-41a2-9b19-36196a05c2ee None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:22.935059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6632b-1d78-4fd0-ae8a-82a9ddd6885d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.935240 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6632b-1d78-4fd0-ae8a-82a9ddd6885d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.935511 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6632b-1d78-4fd0-ae8a-82a9ddd6885d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.937118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 159/325] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:22.942752 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935990aa-b990-4abd-a477-8cd4464100df None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.943032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935990aa-b990-4abd-a477-8cd4464100df None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.943299 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935990aa-b990-4abd-a477-8cd4464100df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.959983 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-935990aa-b990-4abd-a477-8cd4464100df None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:22.961194 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-935990aa-b990-4abd-a477-8cd4464100df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:23.017041 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb86144-44fb-41a2-9b19-36196a05c2ee None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:23.030729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:23.042648 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 160/326] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:23.057658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fbd8f-0a67-456d-b38e-7480600cd770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:23.058494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fbd8f-0a67-456d-b38e-7480600cd770 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:23.058777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fbd8f-0a67-456d-b38e-7480600cd770 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:23.059048 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fbd8f-0a67-456d-b38e-7480600cd770 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:23.065155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935990aa-b990-4abd-a477-8cd4464100df None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:23.069663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fbd8f-0a67-456d-b38e-7480600cd770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-b48fbd8f-0a67-456d-b38e-7480600cd770 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:23.077512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:23.078419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:23.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 167/327] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:23.085981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fbd8f-0a67-456d-b38e-7480600cd770 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:23.133762 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:23.192873 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935990aa-b990-4abd-a477-8cd4464100df None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:23.198254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fbd8f-0a67-456d-b38e-7480600cd770 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:23.235537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da0778-1522-47aa-95ae-29638c1718b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:23.236346 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0778-1522-47aa-95ae-29638c1718b6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:23.236637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0778-1522-47aa-95ae-29638c1718b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:23.236899 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0778-1522-47aa-95ae-29638c1718b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:23.238957 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc152-2905-4d7e-94ab-d4eb4e95159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:23.239982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc152-2905-4d7e-94ab-d4eb4e95159b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:23.240507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc152-2905-4d7e-94ab-d4eb4e95159b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:23.240969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc152-2905-4d7e-94ab-d4eb4e95159b None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:23.242007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dc152-2905-4d7e-94ab-d4eb4e95159b None admin] RBAC: Adding query filter params (name=member) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:23.242507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dc152-2905-4d7e-94ab-d4eb4e95159b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:23.244239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dc152-2905-4d7e-94ab-d4eb4e95159b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:23.248316 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da0778-1522-47aa-95ae-29638c1718b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:23.254237 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 168/328] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-a4da0778-1522-47aa-95ae-29638c1718b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:23.257657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:23.258543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:23.259334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:23.259334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:23.259334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:23.259334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:23.259334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:23.259334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:23.259334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:23.259334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:23.259334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:23.259334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:23.259334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:23.259334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:23.259937 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 161/329] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:23.263108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc152-2905-4d7e-94ab-d4eb4e95159b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:23.266070 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da0778-1522-47aa-95ae-29638c1718b6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:23.332490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:23.388306 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da0778-1522-47aa-95ae-29638c1718b6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:23.412450 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc152-2905-4d7e-94ab-d4eb4e95159b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:23.415932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:23.433129 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc2733-2672-486c-9741-13cfb30be77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:23.433858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc2733-2672-486c-9741-13cfb30be77c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:23.434142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc2733-2672-486c-9741-13cfb30be77c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:23.434471 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc2733-2672-486c-9741-13cfb30be77c None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:23.435431 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc2733-2672-486c-9741-13cfb30be77c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:23.435602 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc2733-2672-486c-9741-13cfb30be77c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:23.436994 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc2733-2672-486c-9741-13cfb30be77c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:23.446368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 162/330] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:23.452185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc2733-2672-486c-9741-13cfb30be77c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:23.454777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1d257-cc6c-489b-90b3-512d3e140101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:23.455939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1d257-cc6c-489b-90b3-512d3e140101 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:23.456522 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1d257-cc6c-489b-90b3-512d3e140101 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:23.456985 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1d257-cc6c-489b-90b3-512d3e140101 None admin] PATH_INFO: `/v3/users/8a40114b1eff4fc2b34a585e1e8034a8` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:23.458445 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1d257-cc6c-489b-90b3-512d3e140101 None admin] RBAC: Authorizing `identity:get_user(user_id=8a40114b1eff4fc2b34a585e1e8034a8)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:23.460114 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1d257-cc6c-489b-90b3-512d3e140101 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:23.462014 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 169/331] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:23 2022] GET /identity/v3/users/8a40114b1eff4fc2b34a585e1e8034a8 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:23.468619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1d257-cc6c-489b-90b3-512d3e140101 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:23.559535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc2733-2672-486c-9741-13cfb30be77c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:23.573889 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1d257-cc6c-489b-90b3-512d3e140101 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:23.585028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:23.603149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d4601-6a71-4cce-a4b2-c7557c881af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:23.604280 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d4601-6a71-4cce-a4b2-c7557c881af1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:23.604388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d4601-6a71-4cce-a4b2-c7557c881af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:23.604578 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d4601-6a71-4cce-a4b2-c7557c881af1 None admin] PATH_INFO: `/v3/users/51759863324d40309845a811897db967` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:23.605836 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d4601-6a71-4cce-a4b2-c7557c881af1 None admin] RBAC: Authorizing `identity:get_user(user_id=51759863324d40309845a811897db967)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:23.607397 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d4601-6a71-4cce-a4b2-c7557c881af1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:23.614119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 163/332] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:23 2022] GET /identity/v3/users/51759863324d40309845a811897db967 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:23.615386 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d4601-6a71-4cce-a4b2-c7557c881af1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:23.617534 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ffba9-48fe-45b7-a932-4e1c78993bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:23.618395 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ffba9-48fe-45b7-a932-4e1c78993bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:23.618814 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ffba9-48fe-45b7-a932-4e1c78993bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:23.619222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ffba9-48fe-45b7-a932-4e1c78993bc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:23.620203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ffba9-48fe-45b7-a932-4e1c78993bc6 None admin] RBAC: Adding query filter params (role.id=2099e2212de24144b089730e7db8ed3a, user.id=8a40114b1eff4fc2b34a585e1e8034a8, scope.system=all) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:23.620665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ffba9-48fe-45b7-a932-4e1c78993bc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:23.622302 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ffba9-48fe-45b7-a932-4e1c78993bc6 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:23.641328 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 170/333] 10.222.0.43 () {56 vars in 1308 bytes} [Sun Jul 24 00:52:23 2022] GET /identity/v3/role_assignments?user.id=8a40114b1eff4fc2b34a585e1e8034a8&scope.system=all&role.id=2099e2212de24144b089730e7db8ed3a => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:23.732544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d4601-6a71-4cce-a4b2-c7557c881af1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:23.770246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615e585-13cc-4ff6-bc5a-3efdaa340a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:23.771140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615e585-13cc-4ff6-bc5a-3efdaa340a3c None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:23.771426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615e585-13cc-4ff6-bc5a-3efdaa340a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:23.771799 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615e585-13cc-4ff6-bc5a-3efdaa340a3c None admin] PATH_INFO: `/v3/system/users/51759863324d40309845a811897db967/roles/56edef813db54c3c826f9af018142f20` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:23.773473 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615e585-13cc-4ff6-bc5a-3efdaa340a3c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=51759863324d40309845a811897db967, role_id=56edef813db54c3c826f9af018142f20)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:23.774955 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615e585-13cc-4ff6-bc5a-3efdaa340a3c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:23.786562 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 164/334] 10.222.0.43 () {58 vars in 1334 bytes} [Sun Jul 24 00:52:23 2022] PUT /identity/v3/system/users/51759863324d40309845a811897db967/roles/56edef813db54c3c826f9af018142f20 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:25.119517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef039e-684b-4b48-9f1a-cc6cc0628ddb None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.121339 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef039e-684b-4b48-9f1a-cc6cc0628ddb None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.121811 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef039e-684b-4b48-9f1a-cc6cc0628ddb None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.123383 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 171/335] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:25.129704 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d15b4-5658-4a45-b3b7-7df61d736549 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.130526 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d15b4-5658-4a45-b3b7-7df61d736549 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.131004 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d15b4-5658-4a45-b3b7-7df61d736549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.150550 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9c7d15b4-5658-4a45-b3b7-7df61d736549 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:25.152054 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9c7d15b4-5658-4a45-b3b7-7df61d736549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:25.209224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:25.231698 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 165/336] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:25.267579 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef039e-684b-4b48-9f1a-cc6cc0628ddb None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:25.306639 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:25.386271 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef039e-684b-4b48-9f1a-cc6cc0628ddb None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:25.430791 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a81fd6-2d81-47dd-aff3-1bea21659ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:25.431607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a81fd6-2d81-47dd-aff3-1bea21659ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.431888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a81fd6-2d81-47dd-aff3-1bea21659ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.432160 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a81fd6-2d81-47dd-aff3-1bea21659ca5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.448995 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a81fd6-2d81-47dd-aff3-1bea21659ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-21a81fd6-2d81-47dd-aff3-1bea21659ca5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:25.456918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:25.457937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:25.458736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:25.458736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:25.458736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:25.458736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:25.458736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:25.458736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:25.458736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:25.458736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:25.458736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:25.458736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:25.458736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:25.458736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:25.460937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 172/337] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:25.466357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d15b4-5658-4a45-b3b7-7df61d736549 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:25.532705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d8c90-77e5-4ff5-979f-88f357b4effb None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.533032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d8c90-77e5-4ff5-979f-88f357b4effb None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.533335 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d8c90-77e5-4ff5-979f-88f357b4effb None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.534901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 173/338] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:25.541109 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3569fb6-53c2-4986-b2c1-1398babae220 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.541421 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3569fb6-53c2-4986-b2c1-1398babae220 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.541700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3569fb6-53c2-4986-b2c1-1398babae220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.575519 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e3569fb6-53c2-4986-b2c1-1398babae220 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:25.576733 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e3569fb6-53c2-4986-b2c1-1398babae220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:25.650179 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d15b4-5658-4a45-b3b7-7df61d736549 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:25.697177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39003354-d166-4e5f-a5fc-dee5cefd586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:25.697904 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003354-d166-4e5f-a5fc-dee5cefd586e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.698184 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003354-d166-4e5f-a5fc-dee5cefd586e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.698509 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003354-d166-4e5f-a5fc-dee5cefd586e None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.699699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39003354-d166-4e5f-a5fc-dee5cefd586e None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:25.700022 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39003354-d166-4e5f-a5fc-dee5cefd586e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:25.701835 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39003354-d166-4e5f-a5fc-dee5cefd586e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:25.705443 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 174/339] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:25.710870 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 166/340] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:25.717017 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3569fb6-53c2-4986-b2c1-1398babae220 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:25.741325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:25.754555 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39003354-d166-4e5f-a5fc-dee5cefd586e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:25.837334 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3569fb6-53c2-4986-b2c1-1398babae220 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:25.841230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:25.877699 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d49ff-8d43-4541-a486-f21fc6b00a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:25.878858 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d49ff-8d43-4541-a486-f21fc6b00a3c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.879334 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d49ff-8d43-4541-a486-f21fc6b00a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.879819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d49ff-8d43-4541-a486-f21fc6b00a3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.934376 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39003354-d166-4e5f-a5fc-dee5cefd586e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:25.952599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d49ff-8d43-4541-a486-f21fc6b00a3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:25.955456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d49ff-8d43-4541-a486-f21fc6b00a3c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:25.977699 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:25.987278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffd2ab-23be-4654-b4ff-8777c81a0136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:25.988148 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffd2ab-23be-4654-b4ff-8777c81a0136 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.988430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffd2ab-23be-4654-b4ff-8777c81a0136 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.988895 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffd2ab-23be-4654-b4ff-8777c81a0136 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.003657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffd2ab-23be-4654-b4ff-8777c81a0136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-18ffd2ab-23be-4654-b4ff-8777c81a0136 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:26.015825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:26.016741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:26.017568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 167/341] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:26.023165 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffd2ab-23be-4654-b4ff-8777c81a0136 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.064174 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 175/342] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:26.065938 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c31b4-13e0-434c-8db0-66d6c5cb4800 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.066449 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c31b4-13e0-434c-8db0-66d6c5cb4800 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.066915 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c31b4-13e0-434c-8db0-66d6c5cb4800 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.068680 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 176/343] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:26.073929 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162c32f-fd43-4572-a44a-a8f7c8429ad2 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.074454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162c32f-fd43-4572-a44a-a8f7c8429ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.074928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162c32f-fd43-4572-a44a-a8f7c8429ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.093027 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4162c32f-fd43-4572-a44a-a8f7c8429ad2 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:26.094858 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4162c32f-fd43-4572-a44a-a8f7c8429ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:26.177634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffd2ab-23be-4654-b4ff-8777c81a0136 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.181493 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.198279 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 177/344] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:26.199117 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162c32f-fd43-4572-a44a-a8f7c8429ad2 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.245023 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f514c-a305-486b-80f2-e1662b251fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.245755 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f514c-a305-486b-80f2-e1662b251fdc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.246033 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f514c-a305-486b-80f2-e1662b251fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.246304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f514c-a305-486b-80f2-e1662b251fdc None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.247070 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f514c-a305-486b-80f2-e1662b251fdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:26.247374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f514c-a305-486b-80f2-e1662b251fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:26.248800 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f514c-a305-486b-80f2-e1662b251fdc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:26.264456 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 168/345] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:26.265153 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f514c-a305-486b-80f2-e1662b251fdc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.295649 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.350610 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162c32f-fd43-4572-a44a-a8f7c8429ad2 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.389914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c990ce-f507-419b-9a59-50f8c6b1de1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.391045 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c990ce-f507-419b-9a59-50f8c6b1de1f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.391473 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c990ce-f507-419b-9a59-50f8c6b1de1f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.391915 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c990ce-f507-419b-9a59-50f8c6b1de1f None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.393325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c990ce-f507-419b-9a59-50f8c6b1de1f None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:26.395018 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c990ce-f507-419b-9a59-50f8c6b1de1f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:26.396890 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 178/346] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:26.397880 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c990ce-f507-419b-9a59-50f8c6b1de1f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.402295 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f514c-a305-486b-80f2-e1662b251fdc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.449560 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed63440-5eb8-427c-8b5b-5b7daf48a734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.450606 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed63440-5eb8-427c-8b5b-5b7daf48a734 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.451095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed63440-5eb8-427c-8b5b-5b7daf48a734 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.451574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed63440-5eb8-427c-8b5b-5b7daf48a734 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.479220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed63440-5eb8-427c-8b5b-5b7daf48a734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-fed63440-5eb8-427c-8b5b-5b7daf48a734 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:26.493247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:26.494213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:26.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:26.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:26.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:26.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:26.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:26.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:26.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:26.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:26.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:26.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:26.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:26.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:26.498063 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 169/347] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:26.499121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed63440-5eb8-427c-8b5b-5b7daf48a734 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.514066 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c990ce-f507-419b-9a59-50f8c6b1de1f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.549010 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.553465 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.566868 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52b026-27a2-4b4a-8209-fe47cd76c0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.567627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52b026-27a2-4b4a-8209-fe47cd76c0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.567987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52b026-27a2-4b4a-8209-fe47cd76c0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.568686 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52b026-27a2-4b4a-8209-fe47cd76c0e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.650538 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52b026-27a2-4b4a-8209-fe47cd76c0e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:26.652066 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52b026-27a2-4b4a-8209-fe47cd76c0e8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:26.720238 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed63440-5eb8-427c-8b5b-5b7daf48a734 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.762918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 179/348] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:26.763789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52b026-27a2-4b4a-8209-fe47cd76c0e8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.786533 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faad7c-a6fb-4944-9451-dd43ed240fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.787426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faad7c-a6fb-4944-9451-dd43ed240fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.787706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faad7c-a6fb-4944-9451-dd43ed240fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.787978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faad7c-a6fb-4944-9451-dd43ed240fa0 None admin] PATH_INFO: `/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.788428 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.801908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faad7c-a6fb-4944-9451-dd43ed240fa0 None admin] RBAC: Authorizing `identity:get_group(group_id=ba740aa0106a4deaa5a02685e1ae35ff)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:26.803407 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faad7c-a6fb-4944-9451-dd43ed240fa0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:26.805506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 170/349] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:26.806311 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faad7c-a6fb-4944-9451-dd43ed240fa0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.878955 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52b026-27a2-4b4a-8209-fe47cd76c0e8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.913431 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5a19f-ba0e-4eca-a723-02571e093686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.914112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5a19f-ba0e-4eca-a723-02571e093686 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.914395 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5a19f-ba0e-4eca-a723-02571e093686 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5a19f-ba0e-4eca-a723-02571e093686 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.915422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5a19f-ba0e-4eca-a723-02571e093686 None admin] RBAC: Adding query filter params (name=member) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:26.915730 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5a19f-ba0e-4eca-a723-02571e093686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:26.917105 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5a19f-ba0e-4eca-a723-02571e093686 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:26.923711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.926150 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 180/350] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:26.927166 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5a19f-ba0e-4eca-a723-02571e093686 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.937936 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faad7c-a6fb-4944-9451-dd43ed240fa0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.989589 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26879b8-bad1-44ef-bd78-124a89f74edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.990387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26879b8-bad1-44ef-bd78-124a89f74edf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.990669 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26879b8-bad1-44ef-bd78-124a89f74edf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.990936 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26879b8-bad1-44ef-bd78-124a89f74edf None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.993946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26879b8-bad1-44ef-bd78-124a89f74edf None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:26.995487 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26879b8-bad1-44ef-bd78-124a89f74edf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:26.997648 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 171/351] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:26.998607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26879b8-bad1-44ef-bd78-124a89f74edf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.016903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.037037 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5a19f-ba0e-4eca-a723-02571e093686 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.079406 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdcd64-9ec2-4cdf-ba84-5275365f73fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.080098 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdcd64-9ec2-4cdf-ba84-5275365f73fb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.080380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdcd64-9ec2-4cdf-ba84-5275365f73fb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.080660 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdcd64-9ec2-4cdf-ba84-5275365f73fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.081682 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdcd64-9ec2-4cdf-ba84-5275365f73fb None admin] RBAC: Adding query filter params (group.id=ba740aa0106a4deaa5a02685e1ae35ff, role.id=2099e2212de24144b089730e7db8ed3a, scope.project.id=4a8d6d084fc142bf96584a8573fbabd6) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:27.082002 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdcd64-9ec2-4cdf-ba84-5275365f73fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.083464 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdcd64-9ec2-4cdf-ba84-5275365f73fb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.094276 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 181/352] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/role_assignments?group.id=ba740aa0106a4deaa5a02685e1ae35ff&scope.project.id=4a8d6d084fc142bf96584a8573fbabd6&role.id=2099e2212de24144b089730e7db8ed3a => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:27.094973 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdcd64-9ec2-4cdf-ba84-5275365f73fb None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.145774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26879b8-bad1-44ef-bd78-124a89f74edf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.200876 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7b6bd-0bf3-446c-82e4-3321be933f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.201604 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7b6bd-0bf3-446c-82e4-3321be933f67 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.202043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7b6bd-0bf3-446c-82e4-3321be933f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.202458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7b6bd-0bf3-446c-82e4-3321be933f67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.225139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdcd64-9ec2-4cdf-ba84-5275365f73fb None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.261161 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec414d0-d285-4913-a11e-597821bc7a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.262357 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec414d0-d285-4913-a11e-597821bc7a4b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.262784 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec414d0-d285-4913-a11e-597821bc7a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.263201 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec414d0-d285-4913-a11e-597821bc7a4b None admin] PATH_INFO: `/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.264671 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec414d0-d285-4913-a11e-597821bc7a4b None admin] RBAC: Authorizing `identity:get_group(group_id=ba740aa0106a4deaa5a02685e1ae35ff)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.266393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec414d0-d285-4913-a11e-597821bc7a4b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.267289 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.268614 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 182/353] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:27.270234 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52073cbb-c0b6-4328-85b6-c00c4545fe79 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.270661 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52073cbb-c0b6-4328-85b6-c00c4545fe79 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.271102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52073cbb-c0b6-4328-85b6-c00c4545fe79 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.272903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 183/354] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:27.279428 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c624cd-fe1f-4d09-96eb-beae7d6eee38 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.279940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c624cd-fe1f-4d09-96eb-beae7d6eee38 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.280392 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c624cd-fe1f-4d09-96eb-beae7d6eee38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.298832 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e9c624cd-fe1f-4d09-96eb-beae7d6eee38 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:27.300425 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e9c624cd-fe1f-4d09-96eb-beae7d6eee38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:27.307769 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7b6bd-0bf3-446c-82e4-3321be933f67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.309070 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.312867 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7b6bd-0bf3-446c-82e4-3321be933f67 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.380255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 184/355] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:27.381711 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c624cd-fe1f-4d09-96eb-beae7d6eee38 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.496640 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c624cd-fe1f-4d09-96eb-beae7d6eee38 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.544055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 172/356] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:27.545132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7b6bd-0bf3-446c-82e4-3321be933f67 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.548503 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06a801-59b1-4f16-a397-77e2a690767a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.549314 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06a801-59b1-4f16-a397-77e2a690767a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.549595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06a801-59b1-4f16-a397-77e2a690767a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.549866 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06a801-59b1-4f16-a397-77e2a690767a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.550750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06a801-59b1-4f16-a397-77e2a690767a None admin] RBAC: Adding query filter params (group.id=ba740aa0106a4deaa5a02685e1ae35ff, role.id=d91e55b589bd4b9aaab2ab607f087f8d, scope.project.id=4a8d6d084fc142bf96584a8573fbabd6) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:27.551058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06a801-59b1-4f16-a397-77e2a690767a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.552522 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06a801-59b1-4f16-a397-77e2a690767a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.567342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 185/357] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/role_assignments?group.id=ba740aa0106a4deaa5a02685e1ae35ff&scope.project.id=4a8d6d084fc142bf96584a8573fbabd6&role.id=d91e55b589bd4b9aaab2ab607f087f8d => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:27.568688 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe289e-e7b5-4fb8-84e4-24dd11100915 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.568978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe289e-e7b5-4fb8-84e4-24dd11100915 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.569303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe289e-e7b5-4fb8-84e4-24dd11100915 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.572535 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 186/358] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:27.572535 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe289e-e7b5-4fb8-84e4-24dd11100915 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.581673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.627871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.679432 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7b6bd-0bf3-446c-82e4-3321be933f67 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.719084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd829-9a6d-4c72-a355-067e9b8983e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.720332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd829-9a6d-4c72-a355-067e9b8983e6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.720817 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd829-9a6d-4c72-a355-067e9b8983e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.721323 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd829-9a6d-4c72-a355-067e9b8983e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.739703 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fd829-9a6d-4c72-a355-067e9b8983e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:27.740729 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe289e-e7b5-4fb8-84e4-24dd11100915 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b77fd829-9a6d-4c72-a355-067e9b8983e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:27.758492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:27.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:27.760273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:27.760273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:27.760273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:27.760273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:27.760273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:27.760273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:27.760273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:27.760273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:27.760273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:27.760273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:27.760273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:27.760273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:27.764926 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 173/359] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:27.770745 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278141d-25e5-4978-80da-2207f822fbf6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.771321 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278141d-25e5-4978-80da-2207f822fbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.771799 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278141d-25e5-4978-80da-2207f822fbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.791514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6278141d-25e5-4978-80da-2207f822fbf6 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:27.793072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6278141d-25e5-4978-80da-2207f822fbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:27.814061 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935cd2-07b4-4e19-b04a-0370a0dc2b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.814878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935cd2-07b4-4e19-b04a-0370a0dc2b00 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.815159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935cd2-07b4-4e19-b04a-0370a0dc2b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.815432 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935cd2-07b4-4e19-b04a-0370a0dc2b00 None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.816803 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17935cd2-07b4-4e19-b04a-0370a0dc2b00 None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.818310 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17935cd2-07b4-4e19-b04a-0370a0dc2b00 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.824704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 187/360] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:27.825617 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935cd2-07b4-4e19-b04a-0370a0dc2b00 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.867691 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 174/361] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:27.868888 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278141d-25e5-4978-80da-2207f822fbf6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.934065 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.965029 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935cd2-07b4-4e19-b04a-0370a0dc2b00 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.984166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278141d-25e5-4978-80da-2207f822fbf6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.003024 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f7b55-6d63-4c9a-a518-0758445a5e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.003742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f7b55-6d63-4c9a-a518-0758445a5e37 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.004025 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f7b55-6d63-4c9a-a518-0758445a5e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.004298 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f7b55-6d63-4c9a-a518-0758445a5e37 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.005052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f7b55-6d63-4c9a-a518-0758445a5e37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:28.005389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f7b55-6d63-4c9a-a518-0758445a5e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.006777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f7b55-6d63-4c9a-a518-0758445a5e37 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.020526 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 188/362] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.020526 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c5955-3e9f-4077-a1f7-1637c16af574 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.020526 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c5955-3e9f-4077-a1f7-1637c16af574 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.020526 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c5955-3e9f-4077-a1f7-1637c16af574 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.020526 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 189/363] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:28.020526 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c5955-3e9f-4077-a1f7-1637c16af574 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.031660 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370ae9d-5d7a-497e-8b03-1ede9385919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.032919 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370ae9d-5d7a-497e-8b03-1ede9385919d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.033566 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370ae9d-5d7a-497e-8b03-1ede9385919d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.034043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370ae9d-5d7a-497e-8b03-1ede9385919d None admin] PATH_INFO: `/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.035489 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370ae9d-5d7a-497e-8b03-1ede9385919d None admin] RBAC: Authorizing `identity:get_group(group_id=ba740aa0106a4deaa5a02685e1ae35ff)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.037454 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370ae9d-5d7a-497e-8b03-1ede9385919d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.039717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 175/364] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.040800 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370ae9d-5d7a-497e-8b03-1ede9385919d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.127229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c5955-3e9f-4077-a1f7-1637c16af574 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.151148 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370ae9d-5d7a-497e-8b03-1ede9385919d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.162245 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d738b-43f7-4b92-a2c1-3bfc9ce320cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.162945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d738b-43f7-4b92-a2c1-3bfc9ce320cd None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.163225 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d738b-43f7-4b92-a2c1-3bfc9ce320cd None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.163495 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d738b-43f7-4b92-a2c1-3bfc9ce320cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.166394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.169901 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.175973 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d738b-43f7-4b92-a2c1-3bfc9ce320cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-eb1d738b-43f7-4b92-a2c1-3bfc9ce320cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:28.185587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:28.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:28.187361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 190/365] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:28.188043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce47d9-ed0c-4a63-b955-543c1f9b7315 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.188862 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce47d9-ed0c-4a63-b955-543c1f9b7315 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.188862 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce47d9-ed0c-4a63-b955-543c1f9b7315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.198783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a19b38-72b4-429d-979b-67033b8b3ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.200003 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a19b38-72b4-429d-979b-67033b8b3ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.200603 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a19b38-72b4-429d-979b-67033b8b3ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.201074 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a19b38-72b4-429d-979b-67033b8b3ce1 None admin] PATH_INFO: `/v3/users/51759863324d40309845a811897db967` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.202972 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a19b38-72b4-429d-979b-67033b8b3ce1 None admin] RBAC: Authorizing `identity:get_user(user_id=51759863324d40309845a811897db967)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.204649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a19b38-72b4-429d-979b-67033b8b3ce1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.206645 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d1ce47d9-ed0c-4a63-b955-543c1f9b7315 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:28.207106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 176/366] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/users/51759863324d40309845a811897db967 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.207848 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d1ce47d9-ed0c-4a63-b955-543c1f9b7315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:28.208290 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a19b38-72b4-429d-979b-67033b8b3ce1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.281582 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 191/367] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:28.283073 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce47d9-ed0c-4a63-b955-543c1f9b7315 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.324006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a19b38-72b4-429d-979b-67033b8b3ce1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.362213 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc85d7-e604-416b-a470-623fdccf9805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.363299 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc85d7-e604-416b-a470-623fdccf9805 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.363833 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc85d7-e604-416b-a470-623fdccf9805 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.364308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc85d7-e604-416b-a470-623fdccf9805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.365532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc85d7-e604-416b-a470-623fdccf9805 None admin] RBAC: Adding query filter params (group.id=ba740aa0106a4deaa5a02685e1ae35ff, role.id=2099e2212de24144b089730e7db8ed3a, scope.project.id=d96a406ef499477eb6b1ae5573304572) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:28.366050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc85d7-e604-416b-a470-623fdccf9805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.367819 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc85d7-e604-416b-a470-623fdccf9805 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.374611 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 177/368] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/role_assignments?group.id=ba740aa0106a4deaa5a02685e1ae35ff&scope.project.id=d96a406ef499477eb6b1ae5573304572&role.id=2099e2212de24144b089730e7db8ed3a => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.375742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc85d7-e604-416b-a470-623fdccf9805 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.395967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce47d9-ed0c-4a63-b955-543c1f9b7315 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.436313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.439917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.461528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d9070-1378-4fc1-952f-a49477e80952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.462336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d9070-1378-4fc1-952f-a49477e80952 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d9070-1378-4fc1-952f-a49477e80952 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.463282 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d9070-1378-4fc1-952f-a49477e80952 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.464636 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d9070-1378-4fc1-952f-a49477e80952 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:28.465125 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d9070-1378-4fc1-952f-a49477e80952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.471352 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d9070-1378-4fc1-952f-a49477e80952 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.490518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 192/369] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.491628 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d9070-1378-4fc1-952f-a49477e80952 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.510352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc85d7-e604-416b-a470-623fdccf9805 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.593467 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146cf8c-d6bc-4b33-abc2-642a8c60ea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.594155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146cf8c-d6bc-4b33-abc2-642a8c60ea3f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.594439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146cf8c-d6bc-4b33-abc2-642a8c60ea3f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.594712 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146cf8c-d6bc-4b33-abc2-642a8c60ea3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.595566 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146cf8c-d6bc-4b33-abc2-642a8c60ea3f None admin] RBAC: Adding query filter params (role.id=56edef813db54c3c826f9af018142f20, user.id=51759863324d40309845a811897db967, scope.system=all) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:28.595879 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146cf8c-d6bc-4b33-abc2-642a8c60ea3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.599266 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146cf8c-d6bc-4b33-abc2-642a8c60ea3f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.621293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 178/370] 10.222.0.43 () {56 vars in 1308 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/role_assignments?user.id=51759863324d40309845a811897db967&scope.system=all&role.id=56edef813db54c3c826f9af018142f20 => generated 510 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.622200 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146cf8c-d6bc-4b33-abc2-642a8c60ea3f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.717409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d9070-1378-4fc1-952f-a49477e80952 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.763346 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8ae6-12e1-4455-b7ec-7a6fb214ea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.764184 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8ae6-12e1-4455-b7ec-7a6fb214ea89 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.764466 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8ae6-12e1-4455-b7ec-7a6fb214ea89 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.764736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8ae6-12e1-4455-b7ec-7a6fb214ea89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.779635 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146cf8c-d6bc-4b33-abc2-642a8c60ea3f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.791204 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f8ae6-12e1-4455-b7ec-7a6fb214ea89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:28.792884 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-ee0f8ae6-12e1-4455-b7ec-7a6fb214ea89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:28.803621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:28.804601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:28.805448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 193/371] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:28.813061 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8ae6-12e1-4455-b7ec-7a6fb214ea89 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.849606 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab0c0-b9e6-46c5-bc9c-8d4a6d430d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.850275 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab0c0-b9e6-46c5-bc9c-8d4a6d430d8d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.850559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab0c0-b9e6-46c5-bc9c-8d4a6d430d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.850836 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab0c0-b9e6-46c5-bc9c-8d4a6d430d8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.877397 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.931271 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8ae6-12e1-4455-b7ec-7a6fb214ea89 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.968672 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fd43e-37bc-4f90-9e08-64b7b70023fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.969302 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fd43e-37bc-4f90-9e08-64b7b70023fa None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.969585 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fd43e-37bc-4f90-9e08-64b7b70023fa None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.969854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fd43e-37bc-4f90-9e08-64b7b70023fa None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.970614 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fd43e-37bc-4f90-9e08-64b7b70023fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:28.970916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fd43e-37bc-4f90-9e08-64b7b70023fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.972384 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fd43e-37bc-4f90-9e08-64b7b70023fa None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.978884 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ab0c0-b9e6-46c5-bc9c-8d4a6d430d8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.980429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ab0c0-b9e6-46c5-bc9c-8d4a6d430d8d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.981466 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 194/372] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:28.987054 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fd43e-37bc-4f90-9e08-64b7b70023fa None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:29.115812 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fd43e-37bc-4f90-9e08-64b7b70023fa None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:29.128634 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:29.130624 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 179/373] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:29.132055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab0c0-b9e6-46c5-bc9c-8d4a6d430d8d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:29.135917 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:29.157533 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbd778-1ca3-4bee-9cca-4fbff07b5d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:29.158463 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbd778-1ca3-4bee-9cca-4fbff07b5d14 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:29.158749 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbd778-1ca3-4bee-9cca-4fbff07b5d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:29.159032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbd778-1ca3-4bee-9cca-4fbff07b5d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:29.249344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbd778-1ca3-4bee-9cca-4fbff07b5d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:29.250689 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbd778-1ca3-4bee-9cca-4fbff07b5d14 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:29.257447 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab0c0-b9e6-46c5-bc9c-8d4a6d430d8d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:29.321922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998646e-e39c-4738-a9fd-15162b4ee2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:29.322801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998646e-e39c-4738-a9fd-15162b4ee2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:29.323140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998646e-e39c-4738-a9fd-15162b4ee2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:29.323414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998646e-e39c-4738-a9fd-15162b4ee2e2 None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:29.325957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998646e-e39c-4738-a9fd-15162b4ee2e2 None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:29.327415 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998646e-e39c-4738-a9fd-15162b4ee2e2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:29.335387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 180/374] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:29 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:29.336700 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998646e-e39c-4738-a9fd-15162b4ee2e2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:29.429119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 195/375] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:29.435280 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbd778-1ca3-4bee-9cca-4fbff07b5d14 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:29.452912 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:29.458235 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:29.486728 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998646e-e39c-4738-a9fd-15162b4ee2e2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:29.522287 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05248b13-3aed-4b03-84de-0db1aed744fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:29.523417 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05248b13-3aed-4b03-84de-0db1aed744fc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:29.523894 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05248b13-3aed-4b03-84de-0db1aed744fc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:29.524300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05248b13-3aed-4b03-84de-0db1aed744fc None admin] PATH_INFO: `/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:29.525663 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05248b13-3aed-4b03-84de-0db1aed744fc None admin] RBAC: Authorizing `identity:get_group(group_id=ba740aa0106a4deaa5a02685e1ae35ff)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:29.527242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05248b13-3aed-4b03-84de-0db1aed744fc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:29.533310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 181/376] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:29 2022] GET /identity/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:29.535711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05248b13-3aed-4b03-84de-0db1aed744fc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:29.639848 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05248b13-3aed-4b03-84de-0db1aed744fc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:29.675719 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9e50b-bc08-4424-8603-fa36af1d2b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:29.677804 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9e50b-bc08-4424-8603-fa36af1d2b02 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:29.678223 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9e50b-bc08-4424-8603-fa36af1d2b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:29.678629 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9e50b-bc08-4424-8603-fa36af1d2b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:29.679601 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9e50b-bc08-4424-8603-fa36af1d2b02 None admin] RBAC: Adding query filter params (group.id=ba740aa0106a4deaa5a02685e1ae35ff, role.id=d91e55b589bd4b9aaab2ab607f087f8d, scope.project.id=d96a406ef499477eb6b1ae5573304572) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:29.680055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9e50b-bc08-4424-8603-fa36af1d2b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:29.681644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9e50b-bc08-4424-8603-fa36af1d2b02 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:29.688136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbd778-1ca3-4bee-9cca-4fbff07b5d14 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:29.693314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 182/377] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:29 2022] GET /identity/v3/role_assignments?group.id=ba740aa0106a4deaa5a02685e1ae35ff&scope.project.id=d96a406ef499477eb6b1ae5573304572&role.id=d91e55b589bd4b9aaab2ab607f087f8d => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:29.763019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05f6c7-9fe9-441a-991e-0bef76236294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:29.763927 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f6c7-9fe9-441a-991e-0bef76236294 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:29.764216 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f6c7-9fe9-441a-991e-0bef76236294 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:29.764491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f6c7-9fe9-441a-991e-0bef76236294 None admin] PATH_INFO: `/v3/projects/e81f52df030c4fd3aed308eec001fc7b` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:29.770177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05f6c7-9fe9-441a-991e-0bef76236294 None admin] RBAC: Authorizing `identity:get_project(project_id=e81f52df030c4fd3aed308eec001fc7b)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:29.771695 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05f6c7-9fe9-441a-991e-0bef76236294 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:29.774140 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 196/378] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:29 2022] GET /identity/v3/projects/e81f52df030c4fd3aed308eec001fc7b => generated 344 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:29.779879 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9e50b-bc08-4424-8603-fa36af1d2b02 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:29.789074 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:29.915473 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9e50b-bc08-4424-8603-fa36af1d2b02 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:29.955185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d5121-745a-49e6-83f1-d51e78cfb407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:29.956540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d5121-745a-49e6-83f1-d51e78cfb407 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:29.957016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d5121-745a-49e6-83f1-d51e78cfb407 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:29.957506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d5121-745a-49e6-83f1-d51e78cfb407 None admin] PATH_INFO: `/v3/groups/f8d67f8a5a394c51a8a5b47c3b802436` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:29.965859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d5121-745a-49e6-83f1-d51e78cfb407 None admin] RBAC: Authorizing `identity:get_group(group_id=f8d67f8a5a394c51a8a5b47c3b802436)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:29.967633 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d5121-745a-49e6-83f1-d51e78cfb407 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:29.970002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 183/379] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:29 2022] GET /identity/v3/groups/f8d67f8a5a394c51a8a5b47c3b802436 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:29.978356 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05f6c7-9fe9-441a-991e-0bef76236294 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:30.083070 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:30.110936 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05f6c7-9fe9-441a-991e-0bef76236294 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:30.155027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4471e3a-4ea7-457d-9c28-78d9e8d19927 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:30.155742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4471e3a-4ea7-457d-9c28-78d9e8d19927 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:30.156237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4471e3a-4ea7-457d-9c28-78d9e8d19927 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:30.157843 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 184/380] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:30.159686 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c143d-7afd-4a1a-8135-a06b960a5e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:30.160603 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c143d-7afd-4a1a-8135-a06b960a5e7e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:30.161069 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c143d-7afd-4a1a-8135-a06b960a5e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:30.161715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c143d-7afd-4a1a-8135-a06b960a5e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:30.162773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c143d-7afd-4a1a-8135-a06b960a5e7e None admin] RBAC: Adding query filter params (group.id=f8d67f8a5a394c51a8a5b47c3b802436, role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=e81f52df030c4fd3aed308eec001fc7b) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:30.163191 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23aacc5-19c8-44a8-8a5f-576aeaf509bc None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:30.163488 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23aacc5-19c8-44a8-8a5f-576aeaf509bc None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:30.163587 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c143d-7afd-4a1a-8135-a06b960a5e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:30.163762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23aacc5-19c8-44a8-8a5f-576aeaf509bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:30.165703 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c143d-7afd-4a1a-8135-a06b960a5e7e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:30.176499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 197/381] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:29 2022] GET /identity/v3/role_assignments?group.id=f8d67f8a5a394c51a8a5b47c3b802436&scope.project.id=e81f52df030c4fd3aed308eec001fc7b&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:30.177867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345ad81-9cef-426a-a86c-55a37142f72e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:30.178153 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345ad81-9cef-426a-a86c-55a37142f72e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:30.178426 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345ad81-9cef-426a-a86c-55a37142f72e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:30.180905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 198/382] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:30.185435 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095f27-0469-4aa3-a76d-9780983a00c5 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:30.185725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095f27-0469-4aa3-a76d-9780983a00c5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:30.186003 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095f27-0469-4aa3-a76d-9780983a00c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:30.194419 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f23aacc5-19c8-44a8-8a5f-576aeaf509bc None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:30.195991 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f23aacc5-19c8-44a8-8a5f-576aeaf509bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:30.211624 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-05095f27-0469-4aa3-a76d-9780983a00c5 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:30.211624 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-05095f27-0469-4aa3-a76d-9780983a00c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:30.297407 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:30.307852 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 185/383] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:30.330664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 199/384] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:30.346088 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23aacc5-19c8-44a8-8a5f-576aeaf509bc None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:30.388201 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05095f27-0469-4aa3-a76d-9780983a00c5 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:30.487856 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:30.493469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23aacc5-19c8-44a8-8a5f-576aeaf509bc None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:30.525759 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05095f27-0469-4aa3-a76d-9780983a00c5 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:30.539894 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aa25c-76b8-4fe3-9eb8-64f827f382b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:30.541031 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aa25c-76b8-4fe3-9eb8-64f827f382b7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:30.541774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aa25c-76b8-4fe3-9eb8-64f827f382b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:30.542486 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aa25c-76b8-4fe3-9eb8-64f827f382b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:30.555896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aa25c-76b8-4fe3-9eb8-64f827f382b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-3a8aa25c-76b8-4fe3-9eb8-64f827f382b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:30.565959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:30.567002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:30.568101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:30.568101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:30.568101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:30.568101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:30.568101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:30.568101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:30.568101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:30.568101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:30.568101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:30.568101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:30.568101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:30.568101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:30.571206 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 186/385] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:30.576643 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aa25c-76b8-4fe3-9eb8-64f827f382b7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:30.578352 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dba27-5d82-4ec4-8cb2-b3bc0063d6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:30.579531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dba27-5d82-4ec4-8cb2-b3bc0063d6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:30.580172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dba27-5d82-4ec4-8cb2-b3bc0063d6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:30.580774 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dba27-5d82-4ec4-8cb2-b3bc0063d6a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:30.594578 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19dba27-5d82-4ec4-8cb2-b3bc0063d6a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-c19dba27-5d82-4ec4-8cb2-b3bc0063d6a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:30.603325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:30.604222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:30.605022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:30.605022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:30.605022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:30.605022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:30.605022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:30.605022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:30.605022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:30.605022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:30.605022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:30.605022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:30.605022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:30.605022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:30.613577 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 200/386] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:30.614780 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dba27-5d82-4ec4-8cb2-b3bc0063d6a5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:30.674059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:30.728838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aa25c-76b8-4fe3-9eb8-64f827f382b7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:30.770653 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eee665-4065-41bd-85b0-e4be82d4973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:30.771581 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee665-4065-41bd-85b0-e4be82d4973d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:30.771866 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee665-4065-41bd-85b0-e4be82d4973d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:30.772140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee665-4065-41bd-85b0-e4be82d4973d None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:30.772898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eee665-4065-41bd-85b0-e4be82d4973d None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:30.773216 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eee665-4065-41bd-85b0-e4be82d4973d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:30.774811 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eee665-4065-41bd-85b0-e4be82d4973d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:30.786808 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 187/387] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:30.793565 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eee665-4065-41bd-85b0-e4be82d4973d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:30.841098 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dba27-5d82-4ec4-8cb2-b3bc0063d6a5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:30.913594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:30.920588 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c79d37-8660-4a44-94cc-b641a0e1f3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:30.922050 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c79d37-8660-4a44-94cc-b641a0e1f3ea None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:30.923170 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c79d37-8660-4a44-94cc-b641a0e1f3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:30.923787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c79d37-8660-4a44-94cc-b641a0e1f3ea None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:30.925714 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c79d37-8660-4a44-94cc-b641a0e1f3ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:30.926529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c79d37-8660-4a44-94cc-b641a0e1f3ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:30.929627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c79d37-8660-4a44-94cc-b641a0e1f3ea None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:30.939917 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eee665-4065-41bd-85b0-e4be82d4973d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:30.945553 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 201/388] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:30.952600 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c79d37-8660-4a44-94cc-b641a0e1f3ea None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:30.977572 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:31.002902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5cbf2-e9d2-4e0f-9f6e-f7b6126efff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:31.004309 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5cbf2-e9d2-4e0f-9f6e-f7b6126efff4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.006738 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5cbf2-e9d2-4e0f-9f6e-f7b6126efff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.007211 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5cbf2-e9d2-4e0f-9f6e-f7b6126efff4 None admin] PATH_INFO: `/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.009408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5cbf2-e9d2-4e0f-9f6e-f7b6126efff4 None admin] RBAC: Authorizing `identity:get_group(group_id=ba740aa0106a4deaa5a02685e1ae35ff)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:31.011874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5cbf2-e9d2-4e0f-9f6e-f7b6126efff4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:31.015030 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 188/389] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:30 2022] GET /identity/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:31.020777 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5cbf2-e9d2-4e0f-9f6e-f7b6126efff4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:31.136398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c79d37-8660-4a44-94cc-b641a0e1f3ea None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:31.218470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c968e5-6807-4516-8e8f-a8ad75a124f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:31.221707 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c968e5-6807-4516-8e8f-a8ad75a124f1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.222314 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c968e5-6807-4516-8e8f-a8ad75a124f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.223259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c968e5-6807-4516-8e8f-a8ad75a124f1 None admin] PATH_INFO: `/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.226423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c968e5-6807-4516-8e8f-a8ad75a124f1 None admin] RBAC: Authorizing `identity:get_group(group_id=ba740aa0106a4deaa5a02685e1ae35ff)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:31.228476 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c968e5-6807-4516-8e8f-a8ad75a124f1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:31.230523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5cbf2-e9d2-4e0f-9f6e-f7b6126efff4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:31.234075 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 202/390] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:30 2022] GET /identity/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:31.239400 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c968e5-6807-4516-8e8f-a8ad75a124f1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:31.296872 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9375000-e607-4226-9ae6-98925bf962d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:31.298291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9375000-e607-4226-9ae6-98925bf962d2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.299230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9375000-e607-4226-9ae6-98925bf962d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.299720 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9375000-e607-4226-9ae6-98925bf962d2 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.301162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9375000-e607-4226-9ae6-98925bf962d2 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:31.302996 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9375000-e607-4226-9ae6-98925bf962d2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:31.305317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 189/391] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:31 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:31.312462 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9375000-e607-4226-9ae6-98925bf962d2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:31.383949 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:31.398391 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:31.453835 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c968e5-6807-4516-8e8f-a8ad75a124f1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:31.463060 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9375000-e607-4226-9ae6-98925bf962d2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:31.500937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1be70-8599-4795-bbed-69232955b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:31.502848 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1be70-8599-4795-bbed-69232955b968 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.503405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1be70-8599-4795-bbed-69232955b968 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.503906 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1be70-8599-4795-bbed-69232955b968 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.505565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1be70-8599-4795-bbed-69232955b968 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:31.506031 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee70da-f3b8-4c1f-aa22-d453f8ce53da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:31.507027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee70da-f3b8-4c1f-aa22-d453f8ce53da None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.507447 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee70da-f3b8-4c1f-aa22-d453f8ce53da None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.507689 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1be70-8599-4795-bbed-69232955b968 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:31.507903 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee70da-f3b8-4c1f-aa22-d453f8ce53da None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6/groups/ba740aa0106a4deaa5a02685e1ae35ff/roles/2099e2212de24144b089730e7db8ed3a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.509929 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 203/392] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:31 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:31.510118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee70da-f3b8-4c1f-aa22-d453f8ce53da None admin] RBAC: Authorizing `identity:create_grant(project_id=4a8d6d084fc142bf96584a8573fbabd6, group_id=ba740aa0106a4deaa5a02685e1ae35ff, role_id=2099e2212de24144b089730e7db8ed3a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:31.511406 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640894f-1061-45e2-b7fb-0578005911cf None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.511926 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640894f-1061-45e2-b7fb-0578005911cf None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.512051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee70da-f3b8-4c1f-aa22-d453f8ce53da None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:31.512454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640894f-1061-45e2-b7fb-0578005911cf None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.514123 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 204/393] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:31.519666 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082f9a-63f0-4c8f-b026-95ad35cf9975 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.519989 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082f9a-63f0-4c8f-b026-95ad35cf9975 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.520385 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082f9a-63f0-4c8f-b026-95ad35cf9975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.531231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 190/394] 10.222.0.43 () {58 vars in 1442 bytes} [Sun Jul 24 00:52:31 2022] PUT /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6/groups/ba740aa0106a4deaa5a02685e1ae35ff/roles/2099e2212de24144b089730e7db8ed3a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:31.532445 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee70da-f3b8-4c1f-aa22-d453f8ce53da None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:31.539175 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-42082f9a-63f0-4c8f-b026-95ad35cf9975 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:31.540412 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-42082f9a-63f0-4c8f-b026-95ad35cf9975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:31.639884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 205/395] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:31.655706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee70da-f3b8-4c1f-aa22-d453f8ce53da None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:31.675912 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:31.679669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42082f9a-63f0-4c8f-b026-95ad35cf9975 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:31.698480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b6c7-9de9-40dc-bd2f-9c88b1a9c6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:31.699399 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b6c7-9de9-40dc-bd2f-9c88b1a9c6e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.699687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b6c7-9de9-40dc-bd2f-9c88b1a9c6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.699964 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b6c7-9de9-40dc-bd2f-9c88b1a9c6e1 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6/groups/ba740aa0106a4deaa5a02685e1ae35ff/roles/d91e55b589bd4b9aaab2ab607f087f8d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.702930 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09b6c7-9de9-40dc-bd2f-9c88b1a9c6e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a8d6d084fc142bf96584a8573fbabd6, group_id=ba740aa0106a4deaa5a02685e1ae35ff, role_id=d91e55b589bd4b9aaab2ab607f087f8d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:31.704550 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09b6c7-9de9-40dc-bd2f-9c88b1a9c6e1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:31.722709 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 191/396] 10.222.0.43 () {58 vars in 1442 bytes} [Sun Jul 24 00:52:31 2022] PUT /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6/groups/ba740aa0106a4deaa5a02685e1ae35ff/roles/d91e55b589bd4b9aaab2ab607f087f8d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:31.794361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:31.851428 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42082f9a-63f0-4c8f-b026-95ad35cf9975 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:31.896148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa81403-6215-44e9-a751-9062a35979d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:31.897176 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa81403-6215-44e9-a751-9062a35979d4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.897497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa81403-6215-44e9-a751-9062a35979d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.897878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa81403-6215-44e9-a751-9062a35979d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.914992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa81403-6215-44e9-a751-9062a35979d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-7aa81403-6215-44e9-a751-9062a35979d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:31.923220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:31.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:31.925172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 206/397] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:31.931050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b6c7-9de9-40dc-bd2f-9c88b1a9c6e1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.066616 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b6c7-9de9-40dc-bd2f-9c88b1a9c6e1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.106900 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258b4a0-c83c-45ef-b817-59d8e230147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.107601 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258b4a0-c83c-45ef-b817-59d8e230147e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.107889 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258b4a0-c83c-45ef-b817-59d8e230147e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.108165 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258b4a0-c83c-45ef-b817-59d8e230147e None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.108934 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258b4a0-c83c-45ef-b817-59d8e230147e None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:32.109261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258b4a0-c83c-45ef-b817-59d8e230147e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:32.110679 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258b4a0-c83c-45ef-b817-59d8e230147e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:32.120873 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 192/398] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:32.128731 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa81403-6215-44e9-a751-9062a35979d4 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.261773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa81403-6215-44e9-a751-9062a35979d4 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.290928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:32.310267 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481690a5-ca2c-4f8e-8073-25ecccc2e85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.311547 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481690a5-ca2c-4f8e-8073-25ecccc2e85e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.312034 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481690a5-ca2c-4f8e-8073-25ecccc2e85e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.312510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481690a5-ca2c-4f8e-8073-25ecccc2e85e None admin] PATH_INFO: `/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.313932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481690a5-ca2c-4f8e-8073-25ecccc2e85e None admin] RBAC: Authorizing `identity:get_group(group_id=ba740aa0106a4deaa5a02685e1ae35ff)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:32.315656 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481690a5-ca2c-4f8e-8073-25ecccc2e85e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:32.317954 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 207/399] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:32 2022] GET /identity/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:32.323175 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258b4a0-c83c-45ef-b817-59d8e230147e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.380998 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:32.454828 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258b4a0-c83c-45ef-b817-59d8e230147e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.495454 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f38899-489b-42b3-880d-76fc2f1fa48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.496340 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f38899-489b-42b3-880d-76fc2f1fa48d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.496618 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f38899-489b-42b3-880d-76fc2f1fa48d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.496890 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f38899-489b-42b3-880d-76fc2f1fa48d None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.498126 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f38899-489b-42b3-880d-76fc2f1fa48d None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:32.499589 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f38899-489b-42b3-880d-76fc2f1fa48d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:32.501656 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 193/400] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:32 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:32.510307 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481690a5-ca2c-4f8e-8073-25ecccc2e85e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.627494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481690a5-ca2c-4f8e-8073-25ecccc2e85e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.650698 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292d80b-21b5-4e32-81bb-26525ae26de6 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.651026 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292d80b-21b5-4e32-81bb-26525ae26de6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.651245 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292d80b-21b5-4e32-81bb-26525ae26de6 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.652625 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 194/401] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:32.659089 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa83ae-d241-4602-9588-9efcf5dd138e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.659485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa83ae-d241-4602-9588-9efcf5dd138e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.659771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa83ae-d241-4602-9588-9efcf5dd138e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.680327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9baeb-6210-45fd-866c-fabe5cd235d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.681276 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9baeb-6210-45fd-866c-fabe5cd235d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.681569 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9baeb-6210-45fd-866c-fabe5cd235d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.681836 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9baeb-6210-45fd-866c-fabe5cd235d0 None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572/groups/ba740aa0106a4deaa5a02685e1ae35ff/roles/2099e2212de24144b089730e7db8ed3a` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.685230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9baeb-6210-45fd-866c-fabe5cd235d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d96a406ef499477eb6b1ae5573304572, group_id=ba740aa0106a4deaa5a02685e1ae35ff, role_id=2099e2212de24144b089730e7db8ed3a)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:32.686693 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9baeb-6210-45fd-866c-fabe5cd235d0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:32.693177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ddfa83ae-d241-4602-9588-9efcf5dd138e None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:32.694440 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ddfa83ae-d241-4602-9588-9efcf5dd138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:32.713562 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 208/402] 10.222.0.43 () {58 vars in 1442 bytes} [Sun Jul 24 00:52:32 2022] PUT /identity/v3/projects/d96a406ef499477eb6b1ae5573304572/groups/ba740aa0106a4deaa5a02685e1ae35ff/roles/2099e2212de24144b089730e7db8ed3a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:32.715508 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ec7bf-1659-4d1f-aa69-8b203d189a2e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.715886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ec7bf-1659-4d1f-aa69-8b203d189a2e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.716178 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ec7bf-1659-4d1f-aa69-8b203d189a2e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.718163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 209/403] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:32.727470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fc406-6c68-47b1-9990-dd90b2509ac9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.727832 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fc406-6c68-47b1-9990-dd90b2509ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.728130 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fc406-6c68-47b1-9990-dd90b2509ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.748861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-660fc406-6c68-47b1-9990-dd90b2509ac9 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:32.750323 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-660fc406-6c68-47b1-9990-dd90b2509ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:32.787183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 195/404] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:32.806251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:32.812995 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa83ae-d241-4602-9588-9efcf5dd138e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.838749 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 210/405] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:32.854451 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:32.866196 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fc406-6c68-47b1-9990-dd90b2509ac9 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.936678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa83ae-d241-4602-9588-9efcf5dd138e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.981753 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b81d0-b898-4997-89aa-3dff45f7abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.982582 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b81d0-b898-4997-89aa-3dff45f7abe9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.982863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b81d0-b898-4997-89aa-3dff45f7abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.983135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b81d0-b898-4997-89aa-3dff45f7abe9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.983315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fc406-6c68-47b1-9990-dd90b2509ac9 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.996116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b81d0-b898-4997-89aa-3dff45f7abe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ca0b81d0-b898-4997-89aa-3dff45f7abe9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:33.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:33.008247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:33.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 196/406] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:33.014972 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b81d0-b898-4997-89aa-3dff45f7abe9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.027106 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34f5da-1bce-4983-85a6-3706d3753615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.027922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34f5da-1bce-4983-85a6-3706d3753615 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.028205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34f5da-1bce-4983-85a6-3706d3753615 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.028481 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34f5da-1bce-4983-85a6-3706d3753615 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.041857 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34f5da-1bce-4983-85a6-3706d3753615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-2e34f5da-1bce-4983-85a6-3706d3753615 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:33.051369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:33.053575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:33.055514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 211/407] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:33.060225 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34f5da-1bce-4983-85a6-3706d3753615 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.107492 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:33.130874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:33.136764 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b81d0-b898-4997-89aa-3dff45f7abe9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.176534 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37507986-e499-4aa0-b335-6df3e8bf437e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.177233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37507986-e499-4aa0-b335-6df3e8bf437e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.177528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37507986-e499-4aa0-b335-6df3e8bf437e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.177808 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37507986-e499-4aa0-b335-6df3e8bf437e None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.178674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37507986-e499-4aa0-b335-6df3e8bf437e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:33.178872 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37507986-e499-4aa0-b335-6df3e8bf437e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.180256 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37507986-e499-4aa0-b335-6df3e8bf437e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.181084 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34f5da-1bce-4983-85a6-3706d3753615 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.188859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 197/408] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:33.194459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37507986-e499-4aa0-b335-6df3e8bf437e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.218851 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be727c40-3be0-4894-a8de-fcf58ff18e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.219539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be727c40-3be0-4894-a8de-fcf58ff18e5a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.219909 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be727c40-3be0-4894-a8de-fcf58ff18e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.220195 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be727c40-3be0-4894-a8de-fcf58ff18e5a None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.221066 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be727c40-3be0-4894-a8de-fcf58ff18e5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:33.221401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be727c40-3be0-4894-a8de-fcf58ff18e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.222845 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be727c40-3be0-4894-a8de-fcf58ff18e5a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.232667 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 212/409] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:33.238527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be727c40-3be0-4894-a8de-fcf58ff18e5a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.300559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37507986-e499-4aa0-b335-6df3e8bf437e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.335278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f791de5-cc1c-469b-af7a-99ae261aeaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.336151 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f791de5-cc1c-469b-af7a-99ae261aeaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.336433 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f791de5-cc1c-469b-af7a-99ae261aeaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.336709 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f791de5-cc1c-469b-af7a-99ae261aeaf6 None admin] PATH_INFO: `/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.337919 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f791de5-cc1c-469b-af7a-99ae261aeaf6 None admin] RBAC: Authorizing `identity:get_group(group_id=ba740aa0106a4deaa5a02685e1ae35ff)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.339753 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f791de5-cc1c-469b-af7a-99ae261aeaf6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.341732 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 198/410] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:33 2022] GET /identity/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:33.347409 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f791de5-cc1c-469b-af7a-99ae261aeaf6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.349101 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:33.352831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be727c40-3be0-4894-a8de-fcf58ff18e5a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.376951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:33.393636 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c56e2-c261-43cb-ba31-1ab6828ec43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.394525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c56e2-c261-43cb-ba31-1ab6828ec43d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.394905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c56e2-c261-43cb-ba31-1ab6828ec43d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.395188 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c56e2-c261-43cb-ba31-1ab6828ec43d None admin] PATH_INFO: `/v3/groups/f8d67f8a5a394c51a8a5b47c3b802436` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.396428 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c56e2-c261-43cb-ba31-1ab6828ec43d None admin] RBAC: Authorizing `identity:get_group(group_id=f8d67f8a5a394c51a8a5b47c3b802436)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.398040 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c56e2-c261-43cb-ba31-1ab6828ec43d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.400198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 213/411] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:33 2022] GET /identity/v3/groups/f8d67f8a5a394c51a8a5b47c3b802436 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:33.406060 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c56e2-c261-43cb-ba31-1ab6828ec43d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.457166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f791de5-cc1c-469b-af7a-99ae261aeaf6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.492785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2e03e-9ddf-4ef7-89a6-815d82abbe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.493706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2e03e-9ddf-4ef7-89a6-815d82abbe9b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.493988 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2e03e-9ddf-4ef7-89a6-815d82abbe9b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.494266 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2e03e-9ddf-4ef7-89a6-815d82abbe9b None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.495516 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2e03e-9ddf-4ef7-89a6-815d82abbe9b None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.497004 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2e03e-9ddf-4ef7-89a6-815d82abbe9b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.499082 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 199/412] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:33 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:33.504911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2e03e-9ddf-4ef7-89a6-815d82abbe9b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.521358 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c56e2-c261-43cb-ba31-1ab6828ec43d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.559653 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3a69b-22dd-4675-beda-a16c4edbb544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.560639 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3a69b-22dd-4675-beda-a16c4edbb544 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.560927 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3a69b-22dd-4675-beda-a16c4edbb544 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.561231 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3a69b-22dd-4675-beda-a16c4edbb544 None admin] PATH_INFO: `/v3/projects/e81f52df030c4fd3aed308eec001fc7b` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.562474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3a69b-22dd-4675-beda-a16c4edbb544 None admin] RBAC: Authorizing `identity:get_project(project_id=e81f52df030c4fd3aed308eec001fc7b)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.564199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3a69b-22dd-4675-beda-a16c4edbb544 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.566543 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 214/413] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:33 2022] GET /identity/v3/projects/e81f52df030c4fd3aed308eec001fc7b => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:33.575047 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3a69b-22dd-4675-beda-a16c4edbb544 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.606653 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:33.618146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2e03e-9ddf-4ef7-89a6-815d82abbe9b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.620350 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:33.660359 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290468bf-fe90-4b24-af96-acd925f8dc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.661474 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290468bf-fe90-4b24-af96-acd925f8dc93 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.661755 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290468bf-fe90-4b24-af96-acd925f8dc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.662037 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290468bf-fe90-4b24-af96-acd925f8dc93 None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572/groups/ba740aa0106a4deaa5a02685e1ae35ff/roles/d91e55b589bd4b9aaab2ab607f087f8d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.664508 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290468bf-fe90-4b24-af96-acd925f8dc93 None admin] RBAC: Authorizing `identity:create_grant(project_id=d96a406ef499477eb6b1ae5573304572, group_id=ba740aa0106a4deaa5a02685e1ae35ff, role_id=d91e55b589bd4b9aaab2ab607f087f8d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.666003 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290468bf-fe90-4b24-af96-acd925f8dc93 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.686360 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 200/414] 10.222.0.43 () {58 vars in 1442 bytes} [Sun Jul 24 00:52:33 2022] PUT /identity/v3/projects/d96a406ef499477eb6b1ae5573304572/groups/ba740aa0106a4deaa5a02685e1ae35ff/roles/d91e55b589bd4b9aaab2ab607f087f8d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:52:33.703206 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3a69b-22dd-4675-beda-a16c4edbb544 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.746416 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d4614-b710-4b35-910d-f5b81523e8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.747377 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d4614-b710-4b35-910d-f5b81523e8be None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.747667 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d4614-b710-4b35-910d-f5b81523e8be None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.747993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d4614-b710-4b35-910d-f5b81523e8be None admin] PATH_INFO: `/v3/projects/e81f52df030c4fd3aed308eec001fc7b/groups/f8d67f8a5a394c51a8a5b47c3b802436/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.750384 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d4614-b710-4b35-910d-f5b81523e8be None admin] RBAC: Authorizing `identity:create_grant(project_id=e81f52df030c4fd3aed308eec001fc7b, group_id=f8d67f8a5a394c51a8a5b47c3b802436, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.751894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d4614-b710-4b35-910d-f5b81523e8be None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.777291 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 215/415] 10.222.0.43 () {58 vars in 1442 bytes} [Sun Jul 24 00:52:33 2022] PUT /identity/v3/projects/e81f52df030c4fd3aed308eec001fc7b/groups/f8d67f8a5a394c51a8a5b47c3b802436/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:52:34.512260 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8c2a-8849-4cff-8274-d17313c1e0ce None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:34.513006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8c2a-8849-4cff-8274-d17313c1e0ce None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:34.513006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8c2a-8849-4cff-8274-d17313c1e0ce None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:34.514696 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 201/416] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:34.531178 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252d7bc-a64c-45c9-b9f9-fc98f9f32577 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:34.531814 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252d7bc-a64c-45c9-b9f9-fc98f9f32577 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:34.531814 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252d7bc-a64c-45c9-b9f9-fc98f9f32577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:34.551560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d252d7bc-a64c-45c9-b9f9-fc98f9f32577 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:34.552767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d252d7bc-a64c-45c9-b9f9-fc98f9f32577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:34.647180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 216/417] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:34.663635 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4ef43-ccc5-4898-a1b0-9c134274d1e5 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:34.664238 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4ef43-ccc5-4898-a1b0-9c134274d1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:34.664712 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4ef43-ccc5-4898-a1b0-9c134274d1e5 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:34.666334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 202/418] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:34.673674 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252d7bc-a64c-45c9-b9f9-fc98f9f32577 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:34.675842 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b547edf-a145-4cb5-8cea-c621b3b6f7c2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:34.676134 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b547edf-a145-4cb5-8cea-c621b3b6f7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:34.676413 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b547edf-a145-4cb5-8cea-c621b3b6f7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:34.703020 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:34.706922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4b547edf-a145-4cb5-8cea-c621b3b6f7c2 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:34.708146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4b547edf-a145-4cb5-8cea-c621b3b6f7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:34.787062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 203/419] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:34.810419 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b547edf-a145-4cb5-8cea-c621b3b6f7c2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:34.829786 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252d7bc-a64c-45c9-b9f9-fc98f9f32577 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:34.884405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20027c4-6eaa-4ee9-8f5d-d2a1e62cfc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:34.885321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20027c4-6eaa-4ee9-8f5d-d2a1e62cfc6c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:34.885602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20027c4-6eaa-4ee9-8f5d-d2a1e62cfc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:34.885914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20027c4-6eaa-4ee9-8f5d-d2a1e62cfc6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:34.905980 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20027c4-6eaa-4ee9-8f5d-d2a1e62cfc6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-c20027c4-6eaa-4ee9-8f5d-d2a1e62cfc6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:34.914215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:34.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:34.916306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 217/420] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:34.933549 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20027c4-6eaa-4ee9-8f5d-d2a1e62cfc6c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:34.967007 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:35.004611 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b547edf-a145-4cb5-8cea-c621b3b6f7c2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:35.077192 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806cdc-658d-4086-99e4-2e6203ec614c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:35.077970 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806cdc-658d-4086-99e4-2e6203ec614c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.078251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806cdc-658d-4086-99e4-2e6203ec614c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.078522 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806cdc-658d-4086-99e4-2e6203ec614c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.097233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5806cdc-658d-4086-99e4-2e6203ec614c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b5806cdc-658d-4086-99e4-2e6203ec614c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:35.105121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:35.106035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:35.106832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:35.106832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:35.106832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:35.106832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:35.106832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:35.106832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:35.106832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:35.106832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:35.106832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:35.106832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:35.106832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:35.106832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:35.109701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:35.115124 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 204/421] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:35.116511 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806cdc-658d-4086-99e4-2e6203ec614c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:35.136949 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20027c4-6eaa-4ee9-8f5d-d2a1e62cfc6c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:35.200991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1e930-a8f2-4660-ab9d-c0ac3c69c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:35.201703 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1e930-a8f2-4660-ab9d-c0ac3c69c343 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.201987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1e930-a8f2-4660-ab9d-c0ac3c69c343 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.202263 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1e930-a8f2-4660-ab9d-c0ac3c69c343 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.203028 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1e930-a8f2-4660-ab9d-c0ac3c69c343 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:35.203336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1e930-a8f2-4660-ab9d-c0ac3c69c343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:35.204719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1e930-a8f2-4660-ab9d-c0ac3c69c343 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:35.214392 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 218/422] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:35.221672 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1e930-a8f2-4660-ab9d-c0ac3c69c343 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:35.349689 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806cdc-658d-4086-99e4-2e6203ec614c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:35.388922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1e930-a8f2-4660-ab9d-c0ac3c69c343 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:35.402003 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26787d2e-3351-4389-a650-26366ddd62ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:35.402696 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26787d2e-3351-4389-a650-26366ddd62ba None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.402980 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26787d2e-3351-4389-a650-26366ddd62ba None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.403259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26787d2e-3351-4389-a650-26366ddd62ba None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.404020 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26787d2e-3351-4389-a650-26366ddd62ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:35.404325 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26787d2e-3351-4389-a650-26366ddd62ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:35.405767 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26787d2e-3351-4389-a650-26366ddd62ba None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:35.422164 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 205/423] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:35.428829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26787d2e-3351-4389-a650-26366ddd62ba None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:35.442117 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:35.463322 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e8aa3-5aba-4600-ab71-42dafb37d9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:35.464418 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e8aa3-5aba-4600-ab71-42dafb37d9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.464703 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e8aa3-5aba-4600-ab71-42dafb37d9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.464973 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e8aa3-5aba-4600-ab71-42dafb37d9c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.496689 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:35.559014 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e8aa3-5aba-4600-ab71-42dafb37d9c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:35.560557 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e8aa3-5aba-4600-ab71-42dafb37d9c2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:35.560900 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26787d2e-3351-4389-a650-26366ddd62ba None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:35.605531 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a9ca8-2233-4694-b778-ca6d5321fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:35.606110 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9ca8-2233-4694-b778-ca6d5321fa4e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.606453 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9ca8-2233-4694-b778-ca6d5321fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.606725 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9ca8-2233-4694-b778-ca6d5321fa4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.686781 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a9ca8-2233-4694-b778-ca6d5321fa4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:35.688801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a9ca8-2233-4694-b778-ca6d5321fa4e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:35.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 219/424] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:35.698927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:35.700555 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2460-2069-45d9-8402-6c31192bbbf9 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.701052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2460-2069-45d9-8402-6c31192bbbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.701531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2460-2069-45d9-8402-6c31192bbbf9 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.703017 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 220/425] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:35.703889 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2460-2069-45d9-8402-6c31192bbbf9 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:35.758854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:35.821987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2460-2069-45d9-8402-6c31192bbbf9 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:35.822423 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 206/426] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:52:35.824247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b664ef-ced7-4142-b6d7-1a52a5ac6f5c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.824751 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b664ef-ced7-4142-b6d7-1a52a5ac6f5c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.825270 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b664ef-ced7-4142-b6d7-1a52a5ac6f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.844332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-80b664ef-ced7-4142-b6d7-1a52a5ac6f5c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:35.845987 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-80b664ef-ced7-4142-b6d7-1a52a5ac6f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:35.862728 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b697e53-b658-486a-87ab-e4092ea4a14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:35.864063 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697e53-b658-486a-87ab-e4092ea4a14b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.864353 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697e53-b658-486a-87ab-e4092ea4a14b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.864635 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697e53-b658-486a-87ab-e4092ea4a14b None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.865882 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b697e53-b658-486a-87ab-e4092ea4a14b None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:35.867914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b697e53-b658-486a-87ab-e4092ea4a14b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:35.870421 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 221/427] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:35 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:35.871293 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b697e53-b658-486a-87ab-e4092ea4a14b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:35.927101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 207/428] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:35.928422 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b664ef-ced7-4142-b6d7-1a52a5ac6f5c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:35.974281 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:35.996539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b697e53-b658-486a-87ab-e4092ea4a14b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.014824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.037452 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13804de9-00d5-4803-afee-c4492ad2a6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.038744 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13804de9-00d5-4803-afee-c4492ad2a6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.039262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13804de9-00d5-4803-afee-c4492ad2a6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.039726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13804de9-00d5-4803-afee-c4492ad2a6d0 None admin] PATH_INFO: `/v3/projects/4a8d6d084fc142bf96584a8573fbabd6` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.041117 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13804de9-00d5-4803-afee-c4492ad2a6d0 None admin] RBAC: Authorizing `identity:get_project(project_id=4a8d6d084fc142bf96584a8573fbabd6)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:36.042837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13804de9-00d5-4803-afee-c4492ad2a6d0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:36.044970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 222/429] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:35 2022] GET /identity/v3/projects/4a8d6d084fc142bf96584a8573fbabd6 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:36.046076 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13804de9-00d5-4803-afee-c4492ad2a6d0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.053838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b664ef-ced7-4142-b6d7-1a52a5ac6f5c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.096526 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b773ea-b808-496b-a5cc-13afcccac722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.097607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b773ea-b808-496b-a5cc-13afcccac722 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.097882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b773ea-b808-496b-a5cc-13afcccac722 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.098160 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b773ea-b808-496b-a5cc-13afcccac722 None admin] PATH_INFO: `/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.099424 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b773ea-b808-496b-a5cc-13afcccac722 None admin] RBAC: Authorizing `identity:get_group(group_id=ba740aa0106a4deaa5a02685e1ae35ff)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:36.101556 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b773ea-b808-496b-a5cc-13afcccac722 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:36.103729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 208/430] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:35 2022] GET /identity/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:36.104514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b773ea-b808-496b-a5cc-13afcccac722 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.180500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13804de9-00d5-4803-afee-c4492ad2a6d0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.219974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d20ee1-86f4-43c7-86a9-1ef4fa0ba2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.221370 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d20ee1-86f4-43c7-86a9-1ef4fa0ba2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.221811 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d20ee1-86f4-43c7-86a9-1ef4fa0ba2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.222089 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d20ee1-86f4-43c7-86a9-1ef4fa0ba2b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.233112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d20ee1-86f4-43c7-86a9-1ef4fa0ba2b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:36.234440 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b773ea-b808-496b-a5cc-13afcccac722 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.237130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-70d20ee1-86f4-43c7-86a9-1ef4fa0ba2b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:36.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:36.244646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:36.245597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:36.245597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:36.245597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:36.245597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:36.245597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:36.245597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:36.245597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:36.245597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:36.245597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:36.245597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:36.245597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:36.245597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:36.250547 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 223/431] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:36.251442 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d20ee1-86f4-43c7-86a9-1ef4fa0ba2b5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.281591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1375460-222e-4a45-a882-792f290afcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.282469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375460-222e-4a45-a882-792f290afcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.282758 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375460-222e-4a45-a882-792f290afcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.283029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375460-222e-4a45-a882-792f290afcd4 None admin] PATH_INFO: `/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.284272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1375460-222e-4a45-a882-792f290afcd4 None admin] RBAC: Authorizing `identity:get_group(group_id=ba740aa0106a4deaa5a02685e1ae35ff)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:36.285769 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1375460-222e-4a45-a882-792f290afcd4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:36.290026 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 209/432] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:36.290026 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1375460-222e-4a45-a882-792f290afcd4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.300964 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.356320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d20ee1-86f4-43c7-86a9-1ef4fa0ba2b5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.394638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccf3e1-753e-4005-bbcb-efb613488914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.395572 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccf3e1-753e-4005-bbcb-efb613488914 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.395853 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccf3e1-753e-4005-bbcb-efb613488914 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.396122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccf3e1-753e-4005-bbcb-efb613488914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.396961 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccf3e1-753e-4005-bbcb-efb613488914 None admin] RBAC: Adding query filter params (group.id=ba740aa0106a4deaa5a02685e1ae35ff, role.id=d91e55b589bd4b9aaab2ab607f087f8d, scope.project.id=4a8d6d084fc142bf96584a8573fbabd6) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:36.397119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1375460-222e-4a45-a882-792f290afcd4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.397332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccf3e1-753e-4005-bbcb-efb613488914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:36.399601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccf3e1-753e-4005-bbcb-efb613488914 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:36.417230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 224/433] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/role_assignments?group.id=ba740aa0106a4deaa5a02685e1ae35ff&scope.project.id=4a8d6d084fc142bf96584a8573fbabd6&role.id=d91e55b589bd4b9aaab2ab607f087f8d => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:36.417230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7805-59f8-4e40-843f-d495e7bd58f1 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.417230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7805-59f8-4e40-843f-d495e7bd58f1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.417230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7805-59f8-4e40-843f-d495e7bd58f1 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.417230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 225/434] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:36.417230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7805-59f8-4e40-843f-d495e7bd58f1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.438700 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdfef5-73c0-414c-a49c-203c83a68821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.439425 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdfef5-73c0-414c-a49c-203c83a68821 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.440118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdfef5-73c0-414c-a49c-203c83a68821 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.440118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdfef5-73c0-414c-a49c-203c83a68821 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.440878 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdfef5-73c0-414c-a49c-203c83a68821 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:36.441222 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdfef5-73c0-414c-a49c-203c83a68821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:36.442702 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdfef5-73c0-414c-a49c-203c83a68821 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:36.452784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 210/435] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:36.454230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4733f77-86a1-47e3-8c0b-5ae4eb7c9bad None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.454528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4733f77-86a1-47e3-8c0b-5ae4eb7c9bad None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.454806 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4733f77-86a1-47e3-8c0b-5ae4eb7c9bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.487804 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a4733f77-86a1-47e3-8c0b-5ae4eb7c9bad None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:36.489434 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a4733f77-86a1-47e3-8c0b-5ae4eb7c9bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:36.529283 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.551027 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7805-59f8-4e40-843f-d495e7bd58f1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.561441 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.586148 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 211/436] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:36.587041 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4733f77-86a1-47e3-8c0b-5ae4eb7c9bad None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.593342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21c594-859b-41a6-92ce-504100d1c56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.594013 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21c594-859b-41a6-92ce-504100d1c56f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.594304 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21c594-859b-41a6-92ce-504100d1c56f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.594574 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21c594-859b-41a6-92ce-504100d1c56f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.595465 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21c594-859b-41a6-92ce-504100d1c56f None admin] RBAC: Adding query filter params (group.id=ba740aa0106a4deaa5a02685e1ae35ff, role.id=2099e2212de24144b089730e7db8ed3a, scope.project.id=4a8d6d084fc142bf96584a8573fbabd6) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:36.595726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21c594-859b-41a6-92ce-504100d1c56f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:36.597268 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21c594-859b-41a6-92ce-504100d1c56f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:36.603978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 226/437] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/role_assignments?group.id=ba740aa0106a4deaa5a02685e1ae35ff&scope.project.id=4a8d6d084fc142bf96584a8573fbabd6&role.id=2099e2212de24144b089730e7db8ed3a => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:36.605158 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc620952-7ef7-45b6-9780-d38d915d133e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.605465 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc620952-7ef7-45b6-9780-d38d915d133e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.605751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc620952-7ef7-45b6-9780-d38d915d133e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.607251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 227/438] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:36.613580 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894145-36fa-424f-9f6b-0f1314c3d35d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.613899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894145-36fa-424f-9f6b-0f1314c3d35d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.614364 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894145-36fa-424f-9f6b-0f1314c3d35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.634420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ce894145-36fa-424f-9f6b-0f1314c3d35d None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:36.636023 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ce894145-36fa-424f-9f6b-0f1314c3d35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:36.715640 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4733f77-86a1-47e3-8c0b-5ae4eb7c9bad None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.724491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 228/439] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:36.734951 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce894145-36fa-424f-9f6b-0f1314c3d35d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.753183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170b437-f993-4888-931c-66366d8291c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.754009 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170b437-f993-4888-931c-66366d8291c7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.754207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170b437-f993-4888-931c-66366d8291c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.754454 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170b437-f993-4888-931c-66366d8291c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.790902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.837102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170b437-f993-4888-931c-66366d8291c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:36.837374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170b437-f993-4888-931c-66366d8291c7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:36.857610 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce894145-36fa-424f-9f6b-0f1314c3d35d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.859400 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.898872 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e367c9b-72e7-4374-a300-1701ec4ba62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.899956 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e367c9b-72e7-4374-a300-1701ec4ba62a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.900983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e367c9b-72e7-4374-a300-1701ec4ba62a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.900983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e367c9b-72e7-4374-a300-1701ec4ba62a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.912338 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e367c9b-72e7-4374-a300-1701ec4ba62a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-3e367c9b-72e7-4374-a300-1701ec4ba62a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:36.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:36.921516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:36.922324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 229/440] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:36.922991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e367c9b-72e7-4374-a300-1701ec4ba62a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.964157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 212/441] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:36.964950 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170b437-f993-4888-931c-66366d8291c7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.035690 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.055816 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e367c9b-72e7-4374-a300-1701ec4ba62a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.079997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170b437-f993-4888-931c-66366d8291c7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.101970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2107f-1725-4267-a0ff-6ac43570b0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.102787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2107f-1725-4267-a0ff-6ac43570b0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.103096 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2107f-1725-4267-a0ff-6ac43570b0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2107f-1725-4267-a0ff-6ac43570b0d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.116188 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2107f-1725-4267-a0ff-6ac43570b0d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-c8c2107f-1725-4267-a0ff-6ac43570b0d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:37.123969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:37.124871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:37.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:37.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:37.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:37.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:37.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:37.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:37.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:37.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:37.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:37.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:37.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:37.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:37.126337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9aa5a-bfea-4474-aec6-d287281afcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.126435 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 230/442] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:37.126504 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9aa5a-bfea-4474-aec6-d287281afcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.126504 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9aa5a-bfea-4474-aec6-d287281afcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.126620 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2107f-1725-4267-a0ff-6ac43570b0d1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.126693 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9aa5a-bfea-4474-aec6-d287281afcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.127550 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9aa5a-bfea-4474-aec6-d287281afcc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:37.127873 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9aa5a-bfea-4474-aec6-d287281afcc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.130484 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9aa5a-bfea-4474-aec6-d287281afcc1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.139615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 213/443] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.140696 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9aa5a-bfea-4474-aec6-d287281afcc1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.153701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.227506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2107f-1725-4267-a0ff-6ac43570b0d1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.241671 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9aa5a-bfea-4474-aec6-d287281afcc1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.260374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c785ee-52e0-4022-a289-efcd4ab79d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.261285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c785ee-52e0-4022-a289-efcd4ab79d0b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.261568 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c785ee-52e0-4022-a289-efcd4ab79d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.261843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c785ee-52e0-4022-a289-efcd4ab79d0b None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.263029 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c785ee-52e0-4022-a289-efcd4ab79d0b None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.264505 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c785ee-52e0-4022-a289-efcd4ab79d0b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.265654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.266287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 231/444] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.267049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c785ee-52e0-4022-a289-efcd4ab79d0b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.275966 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4d684-66ab-4139-824b-ba46f9d1a3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.276663 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4d684-66ab-4139-824b-ba46f9d1a3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.276949 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4d684-66ab-4139-824b-ba46f9d1a3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.277251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4d684-66ab-4139-824b-ba46f9d1a3c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.278017 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4d684-66ab-4139-824b-ba46f9d1a3c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:37.278327 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4d684-66ab-4139-824b-ba46f9d1a3c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.279727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4d684-66ab-4139-824b-ba46f9d1a3c0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.288235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 214/445] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.288954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4d684-66ab-4139-824b-ba46f9d1a3c0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.360122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.371556 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c785ee-52e0-4022-a289-efcd4ab79d0b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.393542 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4d684-66ab-4139-824b-ba46f9d1a3c0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.404737 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f37e5-96e8-41bf-91a3-53349fa05697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.405424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f37e5-96e8-41bf-91a3-53349fa05697 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.405709 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f37e5-96e8-41bf-91a3-53349fa05697 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.406059 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f37e5-96e8-41bf-91a3-53349fa05697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.425362 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed27bb0-6568-4d9e-a46d-f645043ecd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.426221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed27bb0-6568-4d9e-a46d-f645043ecd35 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.426495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed27bb0-6568-4d9e-a46d-f645043ecd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.426761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed27bb0-6568-4d9e-a46d-f645043ecd35 None admin] PATH_INFO: `/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.427919 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed27bb0-6568-4d9e-a46d-f645043ecd35 None admin] RBAC: Authorizing `identity:get_group(group_id=ba740aa0106a4deaa5a02685e1ae35ff)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.429410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed27bb0-6568-4d9e-a46d-f645043ecd35 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.431036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 215/446] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.431790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed27bb0-6568-4d9e-a46d-f645043ecd35 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.476931 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f37e5-96e8-41bf-91a3-53349fa05697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.478453 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f37e5-96e8-41bf-91a3-53349fa05697 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.495184 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.538680 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed27bb0-6568-4d9e-a46d-f645043ecd35 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.568487 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.571155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb0ca1-1006-4915-86a4-ee4981933e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.571768 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb0ca1-1006-4915-86a4-ee4981933e90 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.572057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb0ca1-1006-4915-86a4-ee4981933e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.572375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb0ca1-1006-4915-86a4-ee4981933e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.581488 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 232/447] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:37.581488 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f37e5-96e8-41bf-91a3-53349fa05697 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.644670 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb0ca1-1006-4915-86a4-ee4981933e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.646161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb0ca1-1006-4915-86a4-ee4981933e90 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.674669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f37e5-96e8-41bf-91a3-53349fa05697 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.698310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.708555 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a514a07-ceff-40a9-b660-f970f1e1c616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.709240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a514a07-ceff-40a9-b660-f970f1e1c616 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.709527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a514a07-ceff-40a9-b660-f970f1e1c616 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.709803 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a514a07-ceff-40a9-b660-f970f1e1c616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.710631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a514a07-ceff-40a9-b660-f970f1e1c616 None admin] RBAC: Adding query filter params (group.id=ba740aa0106a4deaa5a02685e1ae35ff, role.id=2099e2212de24144b089730e7db8ed3a, scope.project.id=d96a406ef499477eb6b1ae5573304572) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:37.710940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a514a07-ceff-40a9-b660-f970f1e1c616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.712394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a514a07-ceff-40a9-b660-f970f1e1c616 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.718973 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 233/448] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/role_assignments?group.id=ba740aa0106a4deaa5a02685e1ae35ff&scope.project.id=d96a406ef499477eb6b1ae5573304572&role.id=2099e2212de24144b089730e7db8ed3a => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.719764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a514a07-ceff-40a9-b660-f970f1e1c616 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.753179 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 216/449] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:37.754524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb0ca1-1006-4915-86a4-ee4981933e90 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.787628 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.840053 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a514a07-ceff-40a9-b660-f970f1e1c616 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.865726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb0ca1-1006-4915-86a4-ee4981933e90 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.881499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc364b-7e7c-45ab-93ac-843a7cdcf0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.882391 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc364b-7e7c-45ab-93ac-843a7cdcf0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.882674 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc364b-7e7c-45ab-93ac-843a7cdcf0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.883418 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc364b-7e7c-45ab-93ac-843a7cdcf0c3 None admin] PATH_INFO: `/v3/projects/d96a406ef499477eb6b1ae5573304572` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.885728 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc364b-7e7c-45ab-93ac-843a7cdcf0c3 None admin] RBAC: Authorizing `identity:get_project(project_id=d96a406ef499477eb6b1ae5573304572)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.886598 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc364b-7e7c-45ab-93ac-843a7cdcf0c3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.888303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 234/450] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/projects/d96a406ef499477eb6b1ae5573304572 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.894991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc364b-7e7c-45ab-93ac-843a7cdcf0c3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.908314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09daf1-84e7-4a71-8f02-6a31f66506d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.909551 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09daf1-84e7-4a71-8f02-6a31f66506d1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.909835 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09daf1-84e7-4a71-8f02-6a31f66506d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.910137 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09daf1-84e7-4a71-8f02-6a31f66506d1 None admin] PATH_INFO: `/v3/projects/e81f52df030c4fd3aed308eec001fc7b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.911855 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09daf1-84e7-4a71-8f02-6a31f66506d1 None admin] RBAC: Authorizing `identity:get_project(project_id=e81f52df030c4fd3aed308eec001fc7b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.913619 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09daf1-84e7-4a71-8f02-6a31f66506d1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.915796 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 217/451] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/projects/e81f52df030c4fd3aed308eec001fc7b => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.921415 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09daf1-84e7-4a71-8f02-6a31f66506d1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.946873 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:38.016551 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc364b-7e7c-45ab-93ac-843a7cdcf0c3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:38.040425 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:38.045177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09daf1-84e7-4a71-8f02-6a31f66506d1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:38.056733 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6c44c-307b-4d1b-8d00-61b1b647651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:38.058071 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6c44c-307b-4d1b-8d00-61b1b647651d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:38.058478 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6c44c-307b-4d1b-8d00-61b1b647651d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:38.058754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6c44c-307b-4d1b-8d00-61b1b647651d None admin] PATH_INFO: `/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:38.060082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6c44c-307b-4d1b-8d00-61b1b647651d None admin] RBAC: Authorizing `identity:get_group(group_id=ba740aa0106a4deaa5a02685e1ae35ff)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:38.062229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6c44c-307b-4d1b-8d00-61b1b647651d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:38.064183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 235/452] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/groups/ba740aa0106a4deaa5a02685e1ae35ff => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:38.070128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6c44c-307b-4d1b-8d00-61b1b647651d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:38.082905 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079d799-2f3c-4382-8e10-32d99e9d45e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:38.083779 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079d799-2f3c-4382-8e10-32d99e9d45e1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:38.084058 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079d799-2f3c-4382-8e10-32d99e9d45e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:38.084332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079d799-2f3c-4382-8e10-32d99e9d45e1 None admin] PATH_INFO: `/v3/groups/f8d67f8a5a394c51a8a5b47c3b802436` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:38.085538 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079d799-2f3c-4382-8e10-32d99e9d45e1 None admin] RBAC: Authorizing `identity:get_group(group_id=f8d67f8a5a394c51a8a5b47c3b802436)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:38.086994 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079d799-2f3c-4382-8e10-32d99e9d45e1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:38.089012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 218/453] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/groups/f8d67f8a5a394c51a8a5b47c3b802436 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:38.094823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079d799-2f3c-4382-8e10-32d99e9d45e1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:38.168099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6c44c-307b-4d1b-8d00-61b1b647651d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:38.184436 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:38.194148 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079d799-2f3c-4382-8e10-32d99e9d45e1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:38.201915 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46423d6-ba00-4589-9de5-b3cfb9e9a0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:38.202575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46423d6-ba00-4589-9de5-b3cfb9e9a0dc None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:38.202865 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46423d6-ba00-4589-9de5-b3cfb9e9a0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:38.203135 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46423d6-ba00-4589-9de5-b3cfb9e9a0dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:38.203973 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46423d6-ba00-4589-9de5-b3cfb9e9a0dc None admin] RBAC: Adding query filter params (group.id=ba740aa0106a4deaa5a02685e1ae35ff, role.id=d91e55b589bd4b9aaab2ab607f087f8d, scope.project.id=d96a406ef499477eb6b1ae5573304572) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:38.204283 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46423d6-ba00-4589-9de5-b3cfb9e9a0dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:38.205897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46423d6-ba00-4589-9de5-b3cfb9e9a0dc None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:38.211925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 236/454] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:38 2022] GET /identity/v3/role_assignments?group.id=ba740aa0106a4deaa5a02685e1ae35ff&scope.project.id=d96a406ef499477eb6b1ae5573304572&role.id=d91e55b589bd4b9aaab2ab607f087f8d => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:38.228893 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d7f3a-f43b-4685-8810-40718cabd4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:38.229665 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7f3a-f43b-4685-8810-40718cabd4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:38.229942 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7f3a-f43b-4685-8810-40718cabd4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:38.230217 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7f3a-f43b-4685-8810-40718cabd4c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:38.231093 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d7f3a-f43b-4685-8810-40718cabd4c1 None admin] RBAC: Adding query filter params (group.id=f8d67f8a5a394c51a8a5b47c3b802436, role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=e81f52df030c4fd3aed308eec001fc7b) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:38.231410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d7f3a-f43b-4685-8810-40718cabd4c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:38.232916 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d7f3a-f43b-4685-8810-40718cabd4c1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:38.240101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 219/455] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:38 2022] GET /identity/v3/role_assignments?group.id=f8d67f8a5a394c51a8a5b47c3b802436&scope.project.id=e81f52df030c4fd3aed308eec001fc7b&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:40.939336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b155e-a59f-47a9-bc82-b41d8459c78c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:40.939878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b155e-a59f-47a9-bc82-b41d8459c78c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:40.939878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b155e-a59f-47a9-bc82-b41d8459c78c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:40.941554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 237/456] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:40.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3cfbf-0bb8-4f60-ae38-6c75f76c178a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:40.946963 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3cfbf-0bb8-4f60-ae38-6c75f76c178a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:40.947133 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3cfbf-0bb8-4f60-ae38-6c75f76c178a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:40.975278 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1c92-899d-4de6-8ad4-64c39ffb6a0c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:40.975589 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1c92-899d-4de6-8ad4-64c39ffb6a0c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:40.975830 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1c92-899d-4de6-8ad4-64c39ffb6a0c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:40.977235 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 238/457] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:40.978209 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b2b3cfbf-0bb8-4f60-ae38-6c75f76c178a None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:40.979491 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b2b3cfbf-0bb8-4f60-ae38-6c75f76c178a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:40.984697 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d703b-9dcc-4a0e-a525-4f35c8c9401e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:40.985244 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d703b-9dcc-4a0e-a525-4f35c8c9401e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:40.985731 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d703b-9dcc-4a0e-a525-4f35c8c9401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.008043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a84d703b-9dcc-4a0e-a525-4f35c8c9401e None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:41.009283 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a84d703b-9dcc-4a0e-a525-4f35c8c9401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:41.107590 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 220/458] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:41.125586 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:41.139654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3cfbf-0bb8-4f60-ae38-6c75f76c178a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:41.142126 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 239/459] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:41.165758 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d703b-9dcc-4a0e-a525-4f35c8c9401e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:41.302825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:41.319692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3cfbf-0bb8-4f60-ae38-6c75f76c178a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:41.324799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d703b-9dcc-4a0e-a525-4f35c8c9401e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:41.356379 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49a59f-f965-4a4d-87bc-12bb6c7b7543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:41.357798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49a59f-f965-4a4d-87bc-12bb6c7b7543 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.358272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49a59f-f965-4a4d-87bc-12bb6c7b7543 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.358733 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49a59f-f965-4a4d-87bc-12bb6c7b7543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.365796 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4736564-3a8e-46c6-ae15-7076144a974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:41.367096 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4736564-3a8e-46c6-ae15-7076144a974c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.367381 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4736564-3a8e-46c6-ae15-7076144a974c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.367660 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4736564-3a8e-46c6-ae15-7076144a974c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.370933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49a59f-f965-4a4d-87bc-12bb6c7b7543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:41.372589 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49a59f-f965-4a4d-87bc-12bb6c7b7543 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:41.379467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4736564-3a8e-46c6-ae15-7076144a974c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:41.380930 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4736564-3a8e-46c6-ae15-7076144a974c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-2a49a59f-f965-4a4d-87bc-12bb6c7b7543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:41.392794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:41.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:41.394556 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:41.394556 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:41.394556 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:41.394556 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:41.396785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 221/460] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:41.398258 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184816c3-09c1-4c4c-9ecc-c58b614a70d5 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.398731 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184816c3-09c1-4c4c-9ecc-c58b614a70d5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.399190 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184816c3-09c1-4c4c-9ecc-c58b614a70d5 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-b4736564-3a8e-46c6-ae15-7076144a974c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:41.400189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:41.400999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:41.401896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:41.401896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:41.401896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:41.401896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:41.402102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 240/461] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:41.408251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4736564-3a8e-46c6-ae15-7076144a974c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:41.408366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 222/462] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:41.408366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184816c3-09c1-4c4c-9ecc-c58b614a70d5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:41.450408 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:41.516959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184816c3-09c1-4c4c-9ecc-c58b614a70d5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:41.523041 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4736564-3a8e-46c6-ae15-7076144a974c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:41.552433 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bc725-295c-429b-9a5f-2fdbd2b19f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:41.553300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bc725-295c-429b-9a5f-2fdbd2b19f35 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.553520 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bc725-295c-429b-9a5f-2fdbd2b19f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.553797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bc725-295c-429b-9a5f-2fdbd2b19f35 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.554535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bc725-295c-429b-9a5f-2fdbd2b19f35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:41.554843 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bc725-295c-429b-9a5f-2fdbd2b19f35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:41.556462 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bc725-295c-429b-9a5f-2fdbd2b19f35 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:41.560576 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8eb46e-c716-4fc5-820c-d60be7c2cb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:41.561363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eb46e-c716-4fc5-820c-d60be7c2cb7a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.561649 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eb46e-c716-4fc5-820c-d60be7c2cb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.561923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eb46e-c716-4fc5-820c-d60be7c2cb7a None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.562644 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eb46e-c716-4fc5-820c-d60be7c2cb7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:41.562946 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eb46e-c716-4fc5-820c-d60be7c2cb7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:41.564416 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eb46e-c716-4fc5-820c-d60be7c2cb7a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:41.569288 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:41.580664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 241/463] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:41.580664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef24d2-ec33-40b9-9f25-1ee8cbc8d6ee None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.580664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef24d2-ec33-40b9-9f25-1ee8cbc8d6ee None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.580664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef24d2-ec33-40b9-9f25-1ee8cbc8d6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.581064 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 223/464] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:41.581064 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c35eee-9358-46d2-a9c0-1812c2704dff None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.581189 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c35eee-9358-46d2-a9c0-1812c2704dff None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.581683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c35eee-9358-46d2-a9c0-1812c2704dff None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.582840 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 224/465] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:41.586057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c35eee-9358-46d2-a9c0-1812c2704dff None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:41.604095 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b4ef24d2-ec33-40b9-9f25-1ee8cbc8d6ee None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:41.605309 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b4ef24d2-ec33-40b9-9f25-1ee8cbc8d6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:41.677372 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 242/466] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:41.682462 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef24d2-ec33-40b9-9f25-1ee8cbc8d6ee None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:41.698119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c35eee-9358-46d2-a9c0-1812c2704dff None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:41.719946 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:41.734668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c32be-7db5-406f-9aa4-3eae8511b049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:41.735347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c32be-7db5-406f-9aa4-3eae8511b049 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.735621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c32be-7db5-406f-9aa4-3eae8511b049 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.735888 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c32be-7db5-406f-9aa4-3eae8511b049 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.736608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c32be-7db5-406f-9aa4-3eae8511b049 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:41.738102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c32be-7db5-406f-9aa4-3eae8511b049 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:41.757844 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 225/467] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:41 2022] POST /identity/v3/users => generated 248 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:41.759385 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554044-b415-4896-9b7b-49af5bb99ea1 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.759743 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554044-b415-4896-9b7b-49af5bb99ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.760093 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554044-b415-4896-9b7b-49af5bb99ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.782307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a8554044-b415-4896-9b7b-49af5bb99ea1 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:41.783771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a8554044-b415-4896-9b7b-49af5bb99ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:41.814296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef24d2-ec33-40b9-9f25-1ee8cbc8d6ee None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:41.855162 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7900cd9-3fcf-4e60-aa3b-7d63876c7203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:41.855825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:41.856486 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7900cd9-3fcf-4e60-aa3b-7d63876c7203 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.856835 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7900cd9-3fcf-4e60-aa3b-7d63876c7203 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.857179 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7900cd9-3fcf-4e60-aa3b-7d63876c7203 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.858192 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7900cd9-3fcf-4e60-aa3b-7d63876c7203 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:41.859845 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7900cd9-3fcf-4e60-aa3b-7d63876c7203 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:41.882311 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 226/468] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:41.883626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8554044-b415-4896-9b7b-49af5bb99ea1 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:41.892581 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 243/469] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:41 2022] POST /identity/v3/users => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:41.910461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7900cd9-3fcf-4e60-aa3b-7d63876c7203 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.006316 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:42.029760 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8554044-b415-4896-9b7b-49af5bb99ea1 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.036901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7900cd9-3fcf-4e60-aa3b-7d63876c7203 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.071894 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8198299-4523-4208-b996-2e120eab5c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.072090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8198299-4523-4208-b996-2e120eab5c9e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.072353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8198299-4523-4208-b996-2e120eab5c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.072627 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8198299-4523-4208-b996-2e120eab5c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.084504 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8198299-4523-4208-b996-2e120eab5c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.086301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8198299-4523-4208-b996-2e120eab5c9e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.087336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a787-f950-487f-8b7b-2d5ba5960eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.089570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a787-f950-487f-8b7b-2d5ba5960eef None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a787-f950-487f-8b7b-2d5ba5960eef None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.090264 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a787-f950-487f-8b7b-2d5ba5960eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.102693 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a787-f950-487f-8b7b-2d5ba5960eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.104286 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a787-f950-487f-8b7b-2d5ba5960eef None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c8198299-4523-4208-b996-2e120eab5c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:42.106389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:42.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:42.108075 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:42.108075 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:42.108075 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:42.108075 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:42.111446 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 227/470] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:42.113047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a9a1-231a-4649-a9cc-baa334771809 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.113533 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a9a1-231a-4649-a9cc-baa334771809 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.113980 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a9a1-231a-4649-a9cc-baa334771809 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.115457 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 228/471] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:42.119846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7a9a1-231a-4649-a9cc-baa334771809 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-0364a787-f950-487f-8b7b-2d5ba5960eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:42.128260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:42.129151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:42.130320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:42.130320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:42.130320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:42.130320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:42.130320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 244/472] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:42.131054 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc9f82-b5c1-45f5-a77d-1b51c8e77ea5 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.131334 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc9f82-b5c1-45f5-a77d-1b51c8e77ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.131608 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc9f82-b5c1-45f5-a77d-1b51c8e77ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.150113 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-06bc9f82-b5c1-45f5-a77d-1b51c8e77ea5 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:42.151306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-06bc9f82-b5c1-45f5-a77d-1b51c8e77ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:42.166411 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:42.237859 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 245/473] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:42.239480 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc9f82-b5c1-45f5-a77d-1b51c8e77ea5 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.254468 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7a9a1-231a-4649-a9cc-baa334771809 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.299913 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85afa26-5679-4a0f-969c-2d40226f3c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.301236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85afa26-5679-4a0f-969c-2d40226f3c9e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.301645 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85afa26-5679-4a0f-969c-2d40226f3c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.302012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85afa26-5679-4a0f-969c-2d40226f3c9e None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.303115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85afa26-5679-4a0f-969c-2d40226f3c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:42.303518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85afa26-5679-4a0f-969c-2d40226f3c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.305311 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85afa26-5679-4a0f-969c-2d40226f3c9e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.320958 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 229/474] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:42.322431 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85afa26-5679-4a0f-969c-2d40226f3c9e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.323732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:42.375913 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc9f82-b5c1-45f5-a77d-1b51c8e77ea5 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.424804 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0228c-0393-4320-9e7d-c8adb891820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.425906 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0228c-0393-4320-9e7d-c8adb891820d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.426336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0228c-0393-4320-9e7d-c8adb891820d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.427014 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0228c-0393-4320-9e7d-c8adb891820d None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.428040 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0228c-0393-4320-9e7d-c8adb891820d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:42.428963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0228c-0393-4320-9e7d-c8adb891820d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.431080 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0228c-0393-4320-9e7d-c8adb891820d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.442094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:42.448461 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85afa26-5679-4a0f-969c-2d40226f3c9e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.453594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 246/475] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:42.455184 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0228c-0393-4320-9e7d-c8adb891820d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.489479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8434781-a6ba-47d1-9985-4ebb720bf267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.490204 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8434781-a6ba-47d1-9985-4ebb720bf267 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.490436 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8434781-a6ba-47d1-9985-4ebb720bf267 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.490715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8434781-a6ba-47d1-9985-4ebb720bf267 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.491474 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8434781-a6ba-47d1-9985-4ebb720bf267 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.493114 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8434781-a6ba-47d1-9985-4ebb720bf267 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.504490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.sql.core [None req-c8434781-a6ba-47d1-9985-4ebb720bf267 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 24 00:52:42.504490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 24 00:52:42.504490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [parameters: {'id': '2cfce75c94024bd7b70cf5b51d3344ab', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 24 00:52:42.504490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80202) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c8434781-a6ba-47d1-9985-4ebb720bf267 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application result.read() Jul 24 00:52:42.523224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return ref.to_dict() Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:52:42.524142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application yield resource Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self.session.rollback() Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self.force_reraise() Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise self.value Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application session.commit() Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 24 00:52:42.525072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._prepare_impl() Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self.session.flush() Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._flush(objects) Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application compat.raise_( Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application flush_context.execute() Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rec.execute(self) Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 00:52:42.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:52:42.527426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application result.read() Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:52:42.529166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [parameters: {'id': '2cfce75c94024bd7b70cf5b51d3344ab', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:42.531951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 24 00:52:42.533771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:42.535524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 230/476] 10.222.0.43 () {60 vars in 1131 bytes} [Sun Jul 24 00:52:42 2022] POST /identity/v3/roles => generated 144 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:42.535524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8434781-a6ba-47d1-9985-4ebb720bf267 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.600624 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0228c-0393-4320-9e7d-c8adb891820d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.633579 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:42.639118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f960b-2f23-4269-a579-1d66e72ac61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.639842 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f960b-2f23-4269-a579-1d66e72ac61c None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.640141 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f960b-2f23-4269-a579-1d66e72ac61c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.640416 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f960b-2f23-4269-a579-1d66e72ac61c None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.641125 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f960b-2f23-4269-a579-1d66e72ac61c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.643013 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f960b-2f23-4269-a579-1d66e72ac61c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.645713 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8434781-a6ba-47d1-9985-4ebb720bf267 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.667031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 247/477] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:42 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:42.668171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f960b-2f23-4269-a579-1d66e72ac61c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.685562 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005724a-75b5-4919-b516-d6005825cf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.688040 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005724a-75b5-4919-b516-d6005825cf87 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.688551 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005724a-75b5-4919-b516-d6005825cf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.689102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005724a-75b5-4919-b516-d6005825cf87 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.690133 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005724a-75b5-4919-b516-d6005825cf87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.691714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005724a-75b5-4919-b516-d6005825cf87 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.732400 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 231/478] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:42 2022] POST /identity/v3/users => generated 249 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:42.791113 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f960b-2f23-4269-a579-1d66e72ac61c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.840200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd30e26-cb06-4f25-94f3-9ba02e7c7df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.841410 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd30e26-cb06-4f25-94f3-9ba02e7c7df8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.841839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd30e26-cb06-4f25-94f3-9ba02e7c7df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.842252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd30e26-cb06-4f25-94f3-9ba02e7c7df8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.855182 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd30e26-cb06-4f25-94f3-9ba02e7c7df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-2bd30e26-cb06-4f25-94f3-9ba02e7c7df8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:42.865506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:42.866974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:42.867982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:42.867982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:42.867982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:42.867982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:42.867982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:42.867982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:42.867982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:42.867982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:42.867982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:42.867982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:42.867982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:42.867982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:42.871379 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 248/479] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:42.877958 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005724a-75b5-4919-b516-d6005825cf87 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.909079 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:43.012084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005724a-75b5-4919-b516-d6005825cf87 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:43.047402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd241921-2c7a-4bfc-b841-479a3925f789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:43.048090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241921-2c7a-4bfc-b841-479a3925f789 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:43.048452 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241921-2c7a-4bfc-b841-479a3925f789 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:43.048751 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241921-2c7a-4bfc-b841-479a3925f789 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:43.049554 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd241921-2c7a-4bfc-b841-479a3925f789 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:43.049864 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd241921-2c7a-4bfc-b841-479a3925f789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:43.051304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd241921-2c7a-4bfc-b841-479a3925f789 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:43.060384 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 232/480] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:44.146478 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e601e-e0bd-4ee1-a424-b36eb40106a0 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:44.147006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e601e-e0bd-4ee1-a424-b36eb40106a0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:44.147006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e601e-e0bd-4ee1-a424-b36eb40106a0 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:44.148679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 249/481] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:44.153958 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afb7bd-0e76-4571-8979-8ae5f90f7659 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:44.154358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afb7bd-0e76-4571-8979-8ae5f90f7659 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:44.154546 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afb7bd-0e76-4571-8979-8ae5f90f7659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:44.178238 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-89afb7bd-0e76-4571-8979-8ae5f90f7659 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:44.179456 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-89afb7bd-0e76-4571-8979-8ae5f90f7659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:44.233924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0733bc-2434-4588-89de-08f140681957 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:44.234266 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0733bc-2434-4588-89de-08f140681957 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:44.234479 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0733bc-2434-4588-89de-08f140681957 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:44.241360 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 250/482] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:44.247365 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401e1c4-06d2-4b44-b359-a93fda2305ed None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:44.247719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401e1c4-06d2-4b44-b359-a93fda2305ed None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:44.247929 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401e1c4-06d2-4b44-b359-a93fda2305ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:44.264144 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 233/483] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:44.274591 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a401e1c4-06d2-4b44-b359-a93fda2305ed None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:44.275790 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a401e1c4-06d2-4b44-b359-a93fda2305ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:44.323982 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afb7bd-0e76-4571-8979-8ae5f90f7659 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:44.325717 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:44.357626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:44.380991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 251/484] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:44.403689 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401e1c4-06d2-4b44-b359-a93fda2305ed None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:44.483981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afb7bd-0e76-4571-8979-8ae5f90f7659 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:44.525594 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc875d9-c644-4488-92af-c2ba416da570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:44.526418 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc875d9-c644-4488-92af-c2ba416da570 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:44.526695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc875d9-c644-4488-92af-c2ba416da570 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:44.526989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc875d9-c644-4488-92af-c2ba416da570 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:44.538583 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc875d9-c644-4488-92af-c2ba416da570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-fdc875d9-c644-4488-92af-c2ba416da570 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:44.547158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:44.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:44.548954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 234/485] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:44.556032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc875d9-c644-4488-92af-c2ba416da570 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:44.619146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401e1c4-06d2-4b44-b359-a93fda2305ed None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:44.645654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:44.686503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc875d9-c644-4488-92af-c2ba416da570 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:44.714005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893342-87e0-46e8-b852-61b6fd723dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:44.714999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893342-87e0-46e8-b852-61b6fd723dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:44.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893342-87e0-46e8-b852-61b6fd723dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:44.715556 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893342-87e0-46e8-b852-61b6fd723dd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:44.731173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a9891-ce21-4b9d-b081-5b09385f1b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:44.732258 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a9891-ce21-4b9d-b081-5b09385f1b0b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:44.732759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a9891-ce21-4b9d-b081-5b09385f1b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:44.733299 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a9891-ce21-4b9d-b081-5b09385f1b0b None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:44.734265 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a9891-ce21-4b9d-b081-5b09385f1b0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:44.735010 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a9891-ce21-4b9d-b081-5b09385f1b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:44.736671 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a9891-ce21-4b9d-b081-5b09385f1b0b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:44.746194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce893342-87e0-46e8-b852-61b6fd723dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:44.746723 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 235/486] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-ce893342-87e0-46e8-b852-61b6fd723dd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:44.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:44.754991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:44.755789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 252/487] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:44.757943 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a9891-ce21-4b9d-b081-5b09385f1b0b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:44.761067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893342-87e0-46e8-b852-61b6fd723dd5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:44.809429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:44.921694 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a9891-ce21-4b9d-b081-5b09385f1b0b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:44.957165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893342-87e0-46e8-b852-61b6fd723dd5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:44.959690 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:44.969677 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc5d49-3d2f-4d18-ab9f-a119c8dc3457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:44.970529 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc5d49-3d2f-4d18-ab9f-a119c8dc3457 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:44.970813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc5d49-3d2f-4d18-ab9f-a119c8dc3457 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:44.971088 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc5d49-3d2f-4d18-ab9f-a119c8dc3457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:44.994721 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc5d49-3d2f-4d18-ab9f-a119c8dc3457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:44.996954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc5d49-3d2f-4d18-ab9f-a119c8dc3457 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:45.001844 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5f41e-c875-4b33-a5f1-73481fa3d58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.002795 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5f41e-c875-4b33-a5f1-73481fa3d58a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.003267 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5f41e-c875-4b33-a5f1-73481fa3d58a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.003732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5f41e-c875-4b33-a5f1-73481fa3d58a None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.004687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5f41e-c875-4b33-a5f1-73481fa3d58a None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:45.007899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5f41e-c875-4b33-a5f1-73481fa3d58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:45.009543 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5f41e-c875-4b33-a5f1-73481fa3d58a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:45.026070 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 253/488] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-5ddc5d49-3d2f-4d18-ab9f-a119c8dc3457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:45.030301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:45.031132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:45.031976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:45.031976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:45.031976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:45.031976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:45.032201 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5f41e-c875-4b33-a5f1-73481fa3d58a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.034357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 236/489] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:45.039584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc5d49-3d2f-4d18-ab9f-a119c8dc3457 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:45.224210 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5f41e-c875-4b33-a5f1-73481fa3d58a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.238741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc5d49-3d2f-4d18-ab9f-a119c8dc3457 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.291890 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f522a-a58c-4b8b-ad9f-7f14ef02bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.293626 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f522a-a58c-4b8b-ad9f-7f14ef02bf52 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.294256 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f522a-a58c-4b8b-ad9f-7f14ef02bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.295206 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f522a-a58c-4b8b-ad9f-7f14ef02bf52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.300483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d0f58-85e4-47a3-8166-091637dcfef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.301454 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d0f58-85e4-47a3-8166-091637dcfef1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.301948 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d0f58-85e4-47a3-8166-091637dcfef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.302411 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d0f58-85e4-47a3-8166-091637dcfef1 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.304171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d0f58-85e4-47a3-8166-091637dcfef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:45.304676 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d0f58-85e4-47a3-8166-091637dcfef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:45.308970 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d0f58-85e4-47a3-8166-091637dcfef1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:45.323609 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f522a-a58c-4b8b-ad9f-7f14ef02bf52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:45.325082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f522a-a58c-4b8b-ad9f-7f14ef02bf52 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:45.325646 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 237/490] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:45.327428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6e130-b598-49a7-8d8b-80f3281d45f1 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6e130-b598-49a7-8d8b-80f3281d45f1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.328821 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6e130-b598-49a7-8d8b-80f3281d45f1 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.330397 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 238/491] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:45.331317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6e130-b598-49a7-8d8b-80f3281d45f1 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-cf4f522a-a58c-4b8b-ad9f-7f14ef02bf52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:45.351205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:45.352139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:45.353003 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:45.353003 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:45.353003 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:45.353003 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:45.357216 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 254/492] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:45.358647 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926be02-0d94-4a58-a41d-28a72e27d7b5 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.359176 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926be02-0d94-4a58-a41d-28a72e27d7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.359470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926be02-0d94-4a58-a41d-28a72e27d7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.382761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-1926be02-0d94-4a58-a41d-28a72e27d7b5 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:45.383963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1926be02-0d94-4a58-a41d-28a72e27d7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:45.392094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:45.464792 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6e130-b598-49a7-8d8b-80f3281d45f1 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.469159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 255/493] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:45.470195 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926be02-0d94-4a58-a41d-28a72e27d7b5 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.507155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78d04e-fd8b-4920-a486-bdf28bb9de96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.508134 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78d04e-fd8b-4920-a486-bdf28bb9de96 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.508508 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78d04e-fd8b-4920-a486-bdf28bb9de96 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.508782 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78d04e-fd8b-4920-a486-bdf28bb9de96 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.516371 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78d04e-fd8b-4920-a486-bdf28bb9de96 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:45.518038 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78d04e-fd8b-4920-a486-bdf28bb9de96 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-dd78d04e-fd8b-4920-a486-bdf28bb9de96 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:45.533853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:45.535375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:45.536609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:45.536609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:45.536609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:45.536609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:45.536609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:45.536609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:45.536609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:45.536609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:45.536609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:52:45.536609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:45.539865 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 239/494] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:45.541192 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccb258-2888-4bbc-8e5a-7d13d02f53d3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.541529 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccb258-2888-4bbc-8e5a-7d13d02f53d3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.541805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccb258-2888-4bbc-8e5a-7d13d02f53d3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.543092 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 240/495] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:45.543769 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccb258-2888-4bbc-8e5a-7d13d02f53d3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.565124 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:45.592307 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926be02-0d94-4a58-a41d-28a72e27d7b5 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.627609 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56549bb5-ecac-4a28-bf3c-f50f6033d0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.628377 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56549bb5-ecac-4a28-bf3c-f50f6033d0bf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.628658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56549bb5-ecac-4a28-bf3c-f50f6033d0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.628930 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56549bb5-ecac-4a28-bf3c-f50f6033d0bf None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.629678 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56549bb5-ecac-4a28-bf3c-f50f6033d0bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:45.629983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56549bb5-ecac-4a28-bf3c-f50f6033d0bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:45.631353 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56549bb5-ecac-4a28-bf3c-f50f6033d0bf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:45.647386 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 256/496] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:45.647386 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56549bb5-ecac-4a28-bf3c-f50f6033d0bf None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.665444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccb258-2888-4bbc-8e5a-7d13d02f53d3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.667119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:45.703936 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e448057-4fd4-42fd-921a-7ba9c2cd28bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.704797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448057-4fd4-42fd-921a-7ba9c2cd28bb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.705080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448057-4fd4-42fd-921a-7ba9c2cd28bb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.705511 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448057-4fd4-42fd-921a-7ba9c2cd28bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.716625 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e448057-4fd4-42fd-921a-7ba9c2cd28bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-5e448057-4fd4-42fd-921a-7ba9c2cd28bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:45.724374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:45.725300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:45.726535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 241/497] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:45.727494 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0ba92-fb7b-4bac-9419-46f5e614a2fa None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.727494 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0ba92-fb7b-4bac-9419-46f5e614a2fa None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.727644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0ba92-fb7b-4bac-9419-46f5e614a2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.743832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-34c0ba92-fb7b-4bac-9419-46f5e614a2fa None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:45.745029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-34c0ba92-fb7b-4bac-9419-46f5e614a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:45.745449 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56549bb5-ecac-4a28-bf3c-f50f6033d0bf None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.777794 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984c9cb-dc0e-427a-b647-386c744beeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.778406 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984c9cb-dc0e-427a-b647-386c744beeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.778689 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984c9cb-dc0e-427a-b647-386c744beeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.778965 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984c9cb-dc0e-427a-b647-386c744beeb4 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.779805 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984c9cb-dc0e-427a-b647-386c744beeb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:45.780165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984c9cb-dc0e-427a-b647-386c744beeb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:45.781639 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984c9cb-dc0e-427a-b647-386c744beeb4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:45.783604 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:45.812291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 242/498] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:45.813125 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0ba92-fb7b-4bac-9419-46f5e614a2fa None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.822503 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 257/499] 10.222.0.43 () {56 vars in 1137 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:45.822503 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6553044-efa3-4c4b-ab38-60f5a494975e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.822503 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6553044-efa3-4c4b-ab38-60f5a494975e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.822503 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6553044-efa3-4c4b-ab38-60f5a494975e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.825380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 258/500] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:45.826058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6553044-efa3-4c4b-ab38-60f5a494975e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.905225 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:45.914151 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0ba92-fb7b-4bac-9419-46f5e614a2fa None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.924527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6553044-efa3-4c4b-ab38-60f5a494975e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.947979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1504a7b-223c-4636-91da-878c39346571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.948773 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1504a7b-223c-4636-91da-878c39346571 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.949045 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1504a7b-223c-4636-91da-878c39346571 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.949341 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1504a7b-223c-4636-91da-878c39346571 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.956304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1504a7b-223c-4636-91da-878c39346571 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:45.957814 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1504a7b-223c-4636-91da-878c39346571 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:45.958781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b0392-5ed5-4c21-acd1-9bd3494bb647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.959455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b0392-5ed5-4c21-acd1-9bd3494bb647 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.959739 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b0392-5ed5-4c21-acd1-9bd3494bb647 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.960407 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b0392-5ed5-4c21-acd1-9bd3494bb647 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.960774 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b0392-5ed5-4c21-acd1-9bd3494bb647 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:45.961083 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b0392-5ed5-4c21-acd1-9bd3494bb647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:45.962850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b0392-5ed5-4c21-acd1-9bd3494bb647 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:45.970697 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 259/501] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:45.971472 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b0392-5ed5-4c21-acd1-9bd3494bb647 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-e1504a7b-223c-4636-91da-878c39346571 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:45.972083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:45.973087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:45.974012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:45.974012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:45.974012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:45.974012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:45.974012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:45.974012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:45.974012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:45.974012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:45.974012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:52:45.974012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:45.974012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 243/502] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:45.975162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083acef3-3134-4652-a2eb-01161036241b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.975162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083acef3-3134-4652-a2eb-01161036241b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.975162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083acef3-3134-4652-a2eb-01161036241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.991185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-083acef3-3134-4652-a2eb-01161036241b None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:45.992360 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-083acef3-3134-4652-a2eb-01161036241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:46.031344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.057349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 244/503] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:46.058174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083acef3-3134-4652-a2eb-01161036241b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.078923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b0392-5ed5-4c21-acd1-9bd3494bb647 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.112591 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe2545-c162-4e69-94a5-22a86ae9bdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.113276 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe2545-c162-4e69-94a5-22a86ae9bdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.113566 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe2545-c162-4e69-94a5-22a86ae9bdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.113874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe2545-c162-4e69-94a5-22a86ae9bdd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.150337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.169979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083acef3-3134-4652-a2eb-01161036241b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.179823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe2545-c162-4e69-94a5-22a86ae9bdd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.181316 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe2545-c162-4e69-94a5-22a86ae9bdd7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.203402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c3b25-27d0-4f61-87bb-db5d996db49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.204229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c3b25-27d0-4f61-87bb-db5d996db49e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.204499 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c3b25-27d0-4f61-87bb-db5d996db49e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.204769 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c3b25-27d0-4f61-87bb-db5d996db49e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.216127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c3b25-27d0-4f61-87bb-db5d996db49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-3c4c3b25-27d0-4f61-87bb-db5d996db49e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:46.225014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:46.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:46.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:46.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:46.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:46.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:46.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:46.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:46.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:46.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:46.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:46.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:46.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:46.226730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:46.227858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 245/504] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:46.228446 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c3b25-27d0-4f61-87bb-db5d996db49e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.233572 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.278374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 260/505] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:46.279205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe2545-c162-4e69-94a5-22a86ae9bdd7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.329671 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c3b25-27d0-4f61-87bb-db5d996db49e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.363164 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230fcb1-6be7-466e-86b1-1fad973b21c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.363997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230fcb1-6be7-466e-86b1-1fad973b21c3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.364258 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230fcb1-6be7-466e-86b1-1fad973b21c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230fcb1-6be7-466e-86b1-1fad973b21c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.375391 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230fcb1-6be7-466e-86b1-1fad973b21c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.375507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe2545-c162-4e69-94a5-22a86ae9bdd7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.376970 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230fcb1-6be7-466e-86b1-1fad973b21c3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.378688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-5230fcb1-6be7-466e-86b1-1fad973b21c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:46.395244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:46.396157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:46.396997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:46.396997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:46.396997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:46.396997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:46.396997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 246/506] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:46.397302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230fcb1-6be7-466e-86b1-1fad973b21c3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.411303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a390f-4aad-483f-9d3e-716f38a0ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.411972 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a390f-4aad-483f-9d3e-716f38a0ad12 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.412253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a390f-4aad-483f-9d3e-716f38a0ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.412517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a390f-4aad-483f-9d3e-716f38a0ad12 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.413365 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a390f-4aad-483f-9d3e-716f38a0ad12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:46.413687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a390f-4aad-483f-9d3e-716f38a0ad12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.415103 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a390f-4aad-483f-9d3e-716f38a0ad12 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.432243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 261/507] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:46.433022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a390f-4aad-483f-9d3e-716f38a0ad12 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.447073 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.497897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230fcb1-6be7-466e-86b1-1fad973b21c3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.530701 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c208f7a-0af1-4dc3-bd5b-5e90cf03dae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.531506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c208f7a-0af1-4dc3-bd5b-5e90cf03dae1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.531783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c208f7a-0af1-4dc3-bd5b-5e90cf03dae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.532057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c208f7a-0af1-4dc3-bd5b-5e90cf03dae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.534079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a390f-4aad-483f-9d3e-716f38a0ad12 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.542295 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c208f7a-0af1-4dc3-bd5b-5e90cf03dae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.543751 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c208f7a-0af1-4dc3-bd5b-5e90cf03dae1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-7c208f7a-0af1-4dc3-bd5b-5e90cf03dae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:46.560519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:46.561483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:46.562317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:46.562317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:46.562317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:46.562317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:46.565559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 247/508] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:46.566690 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c208f7a-0af1-4dc3-bd5b-5e90cf03dae1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.571456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386134b-a9dc-415e-b1eb-189babab2878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.572377 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386134b-a9dc-415e-b1eb-189babab2878 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.572884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386134b-a9dc-415e-b1eb-189babab2878 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.573412 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386134b-a9dc-415e-b1eb-189babab2878 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.574453 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386134b-a9dc-415e-b1eb-189babab2878 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:46.574762 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386134b-a9dc-415e-b1eb-189babab2878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.576954 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386134b-a9dc-415e-b1eb-189babab2878 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.590858 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 262/509] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:46.591746 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386134b-a9dc-415e-b1eb-189babab2878 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.623671 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.667132 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.676049 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c208f7a-0af1-4dc3-bd5b-5e90cf03dae1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.692922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386134b-a9dc-415e-b1eb-189babab2878 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.709531 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e8ab4-0737-4906-bc5e-f0a4d93d4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.710362 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e8ab4-0737-4906-bc5e-f0a4d93d4b59 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.710639 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e8ab4-0737-4906-bc5e-f0a4d93d4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.710921 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e8ab4-0737-4906-bc5e-f0a4d93d4b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.721892 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e8ab4-0737-4906-bc5e-f0a4d93d4b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.723400 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e8ab4-0737-4906-bc5e-f0a4d93d4b59 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.725725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f706443-95a5-4110-a5fd-70c25abf97b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.726398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f706443-95a5-4110-a5fd-70c25abf97b3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.726677 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f706443-95a5-4110-a5fd-70c25abf97b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.726943 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f706443-95a5-4110-a5fd-70c25abf97b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.727656 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f706443-95a5-4110-a5fd-70c25abf97b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:46.727950 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f706443-95a5-4110-a5fd-70c25abf97b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.729345 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f706443-95a5-4110-a5fd-70c25abf97b3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-256e8ab4-0737-4906-bc5e-f0a4d93d4b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:46.740274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:46.745759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:46.746674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:46.746674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:46.746674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:46.746674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:46.746901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 263/510] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:46.746972 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 248/511] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:46.746972 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e8ab4-0737-4906-bc5e-f0a4d93d4b59 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.747397 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f706443-95a5-4110-a5fd-70c25abf97b3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.837618 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.841511 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e8ab4-0737-4906-bc5e-f0a4d93d4b59 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.847404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f706443-95a5-4110-a5fd-70c25abf97b3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.875335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4752f5-8edc-4ac7-88ee-bcc987b3e2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.876215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4752f5-8edc-4ac7-88ee-bcc987b3e2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.876505 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4752f5-8edc-4ac7-88ee-bcc987b3e2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.876785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4752f5-8edc-4ac7-88ee-bcc987b3e2b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.877585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4752f5-8edc-4ac7-88ee-bcc987b3e2b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:46.877908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4752f5-8edc-4ac7-88ee-bcc987b3e2b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.879319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4752f5-8edc-4ac7-88ee-bcc987b3e2b2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.883485 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f0824-6e72-4a50-8fbd-59d3d1ac6dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.884062 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f0824-6e72-4a50-8fbd-59d3d1ac6dfa None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.884346 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f0824-6e72-4a50-8fbd-59d3d1ac6dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.884623 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f0824-6e72-4a50-8fbd-59d3d1ac6dfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.887392 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.892858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 249/512] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:46.893545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4752f5-8edc-4ac7-88ee-bcc987b3e2b2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.954198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f0824-6e72-4a50-8fbd-59d3d1ac6dfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.955699 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f0824-6e72-4a50-8fbd-59d3d1ac6dfa None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.997176 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4752f5-8edc-4ac7-88ee-bcc987b3e2b2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.030320 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42769f5-050a-470d-aba0-d3e5123922de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.031120 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42769f5-050a-470d-aba0-d3e5123922de None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.031399 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42769f5-050a-470d-aba0-d3e5123922de None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.031677 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42769f5-050a-470d-aba0-d3e5123922de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.041835 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42769f5-050a-470d-aba0-d3e5123922de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.043295 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42769f5-050a-470d-aba0-d3e5123922de None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.050170 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 264/513] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:47.051064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f0824-6e72-4a50-8fbd-59d3d1ac6dfa None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-d42769f5-050a-470d-aba0-d3e5123922de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:47.065600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:47.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:47.067370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:47.067370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:47.067370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:47.067370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:47.067370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 250/514] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:47.067660 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42769f5-050a-470d-aba0-d3e5123922de None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.080439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.087900 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.152022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f0824-6e72-4a50-8fbd-59d3d1ac6dfa None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.169058 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42769f5-050a-470d-aba0-d3e5123922de None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.186079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218eecc-0e99-4d62-a1dc-3b1303dbf5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.186890 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218eecc-0e99-4d62-a1dc-3b1303dbf5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.187175 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218eecc-0e99-4d62-a1dc-3b1303dbf5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.187452 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218eecc-0e99-4d62-a1dc-3b1303dbf5d4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.194425 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218eecc-0e99-4d62-a1dc-3b1303dbf5d4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.195875 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218eecc-0e99-4d62-a1dc-3b1303dbf5d4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.203468 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f6864-134f-45d8-bfc6-7360f52f337d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.204174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f6864-134f-45d8-bfc6-7360f52f337d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.204458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f6864-134f-45d8-bfc6-7360f52f337d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.204733 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f6864-134f-45d8-bfc6-7360f52f337d None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.205492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f6864-134f-45d8-bfc6-7360f52f337d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:47.205800 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f6864-134f-45d8-bfc6-7360f52f337d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.207170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f6864-134f-45d8-bfc6-7360f52f337d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-1218eecc-0e99-4d62-a1dc-3b1303dbf5d4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:47.211402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:47.212663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:47.213583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:47.213583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:47.213583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:47.213583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:47.213583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:47.213583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:47.213583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:47.213583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:47.213583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:52:47.213583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:47.213583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 265/515] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:47.214371 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218eecc-0e99-4d62-a1dc-3b1303dbf5d4 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.227383 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 251/516] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:47.227383 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f6864-134f-45d8-bfc6-7360f52f337d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.293218 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.323429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f6864-134f-45d8-bfc6-7360f52f337d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.323594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.330971 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218eecc-0e99-4d62-a1dc-3b1303dbf5d4 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.360245 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dd535-f55b-422c-a39b-f77d3f1c6d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.361049 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dd535-f55b-422c-a39b-f77d3f1c6d65 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.361331 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dd535-f55b-422c-a39b-f77d3f1c6d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.361637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dd535-f55b-422c-a39b-f77d3f1c6d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.365538 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ce0d5-2a36-41f7-8c6c-011c80a2e764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.366206 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ce0d5-2a36-41f7-8c6c-011c80a2e764 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.366483 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ce0d5-2a36-41f7-8c6c-011c80a2e764 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.366753 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ce0d5-2a36-41f7-8c6c-011c80a2e764 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.367451 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ce0d5-2a36-41f7-8c6c-011c80a2e764 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.368909 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ce0d5-2a36-41f7-8c6c-011c80a2e764 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.372038 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dd535-f55b-422c-a39b-f77d3f1c6d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.373517 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dd535-f55b-422c-a39b-f77d3f1c6d65 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.388421 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 266/517] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:47 2022] POST /identity/v3/users => generated 247 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:47.389245 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ce0d5-2a36-41f7-8c6c-011c80a2e764 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f44dd535-f55b-422c-a39b-f77d3f1c6d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:47.391993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:47.393080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:47.394111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:47.394111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:47.394111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:47.394111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:47.394111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 252/518] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:47.394111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dd535-f55b-422c-a39b-f77d3f1c6d65 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.514262 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dd535-f55b-422c-a39b-f77d3f1c6d65 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.520397 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ce0d5-2a36-41f7-8c6c-011c80a2e764 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.538004 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.551638 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f807e98-61c5-42ff-a943-2480aaf46e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.552318 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f807e98-61c5-42ff-a943-2480aaf46e7b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.552599 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f807e98-61c5-42ff-a943-2480aaf46e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.552907 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f807e98-61c5-42ff-a943-2480aaf46e7b None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.553872 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f807e98-61c5-42ff-a943-2480aaf46e7b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:47.554278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f807e98-61c5-42ff-a943-2480aaf46e7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.555733 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f807e98-61c5-42ff-a943-2480aaf46e7b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.562497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28485a-0adc-4902-a914-4cc1a1168745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.563157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28485a-0adc-4902-a914-4cc1a1168745 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.563473 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28485a-0adc-4902-a914-4cc1a1168745 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.563750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28485a-0adc-4902-a914-4cc1a1168745 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.564477 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28485a-0adc-4902-a914-4cc1a1168745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:47.564781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28485a-0adc-4902-a914-4cc1a1168745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.566213 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28485a-0adc-4902-a914-4cc1a1168745 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.580424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 267/519] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:47.581337 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28485a-0adc-4902-a914-4cc1a1168745 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.597861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.602284 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 253/520] 10.222.0.43 () {56 vars in 1139 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:47.602798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f807e98-61c5-42ff-a943-2480aaf46e7b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.702366 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28485a-0adc-4902-a914-4cc1a1168745 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.714544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f807e98-61c5-42ff-a943-2480aaf46e7b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.739699 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27947fec-ef20-4ae0-9b92-b209107c8f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.740509 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27947fec-ef20-4ae0-9b92-b209107c8f2b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.740792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27947fec-ef20-4ae0-9b92-b209107c8f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.741067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27947fec-ef20-4ae0-9b92-b209107c8f2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.749102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27947fec-ef20-4ae0-9b92-b209107c8f2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.750581 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27947fec-ef20-4ae0-9b92-b209107c8f2b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.758373 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6877e-563a-4285-8bb0-72572033992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.759050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6877e-563a-4285-8bb0-72572033992d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.759329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6877e-563a-4285-8bb0-72572033992d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.759601 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6877e-563a-4285-8bb0-72572033992d None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.760329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6877e-563a-4285-8bb0-72572033992d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:47.760634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6877e-563a-4285-8bb0-72572033992d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.762050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6877e-563a-4285-8bb0-72572033992d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-27947fec-ef20-4ae0-9b92-b209107c8f2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:47.765317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:47.766136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:47.767022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:47.767022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:47.767022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:47.767022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:47.767022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:47.767022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:47.767022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:47.767022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:47.771339 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 268/521] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:47.772025 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27947fec-ef20-4ae0-9b92-b209107c8f2b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.779047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 254/522] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:47.779047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6877e-563a-4285-8bb0-72572033992d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.820927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.853009 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.881355 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6877e-563a-4285-8bb0-72572033992d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.887468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27947fec-ef20-4ae0-9b92-b209107c8f2b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.915569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1dd2c-cbd2-4d19-9396-8d4f19ee93b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.916229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1dd2c-cbd2-4d19-9396-8d4f19ee93b8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.916513 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1dd2c-cbd2-4d19-9396-8d4f19ee93b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1dd2c-cbd2-4d19-9396-8d4f19ee93b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.927636 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6041ed-5dcb-4911-8515-5ece3f09efd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.928816 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6041ed-5dcb-4911-8515-5ece3f09efd3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.929298 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6041ed-5dcb-4911-8515-5ece3f09efd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.929756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6041ed-5dcb-4911-8515-5ece3f09efd3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.937954 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6041ed-5dcb-4911-8515-5ece3f09efd3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.939570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6041ed-5dcb-4911-8515-5ece3f09efd3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-9b6041ed-5dcb-4911-8515-5ece3f09efd3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:47.954854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:47.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:47.957405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:47.957405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:47.957405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:47.957405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:47.957405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:47.957405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:47.957405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:47.957405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:47.957405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:52:47.957405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:47.957405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 269/523] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:47.957405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6041ed-5dcb-4911-8515-5ece3f09efd3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.989837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1dd2c-cbd2-4d19-9396-8d4f19ee93b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.991301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1dd2c-cbd2-4d19-9396-8d4f19ee93b8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.031968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.061428 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6041ed-5dcb-4911-8515-5ece3f09efd3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.097812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 255/524] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:48.097812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1dd2c-cbd2-4d19-9396-8d4f19ee93b8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.098398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.105396 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9504bc-41fb-4cc7-b078-9eca140ea28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.106087 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9504bc-41fb-4cc7-b078-9eca140ea28f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.106365 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9504bc-41fb-4cc7-b078-9eca140ea28f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.106635 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9504bc-41fb-4cc7-b078-9eca140ea28f None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.107527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9504bc-41fb-4cc7-b078-9eca140ea28f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:48.107841 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9504bc-41fb-4cc7-b078-9eca140ea28f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.109406 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9504bc-41fb-4cc7-b078-9eca140ea28f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.134057 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 270/525] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:48.134057 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9504bc-41fb-4cc7-b078-9eca140ea28f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.201510 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1dd2c-cbd2-4d19-9396-8d4f19ee93b8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.228656 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9504bc-41fb-4cc7-b078-9eca140ea28f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.236936 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b2e9b-be6d-424c-9fad-3665f69d8f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.237775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b2e9b-be6d-424c-9fad-3665f69d8f96 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.238056 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b2e9b-be6d-424c-9fad-3665f69d8f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.238333 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b2e9b-be6d-424c-9fad-3665f69d8f96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.244986 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b2e9b-be6d-424c-9fad-3665f69d8f96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.246486 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b2e9b-be6d-424c-9fad-3665f69d8f96 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.248905 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-d72b2e9b-be6d-424c-9fad-3665f69d8f96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:48.262293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:48.263244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:48.264077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:48.264077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:48.264077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:48.264077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:48.264077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:48.264077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:48.264077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:48.264077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:48.264077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 256/526] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:48.265155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b2e9b-be6d-424c-9fad-3665f69d8f96 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.265625 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c6a47-4de2-45f9-9232-81b2217ba691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.266388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6a47-4de2-45f9-9232-81b2217ba691 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.266668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6a47-4de2-45f9-9232-81b2217ba691 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.266936 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6a47-4de2-45f9-9232-81b2217ba691 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.267773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c6a47-4de2-45f9-9232-81b2217ba691 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:48.268076 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c6a47-4de2-45f9-9232-81b2217ba691 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.269655 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c6a47-4de2-45f9-9232-81b2217ba691 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.289196 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 271/527] 10.222.0.43 () {56 vars in 1137 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:48.290046 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c6a47-4de2-45f9-9232-81b2217ba691 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.340248 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.380616 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b2e9b-be6d-424c-9fad-3665f69d8f96 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.391675 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c6a47-4de2-45f9-9232-81b2217ba691 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.415574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de852c0-7e8d-4299-9e0a-089aec7c8827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.416372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de852c0-7e8d-4299-9e0a-089aec7c8827 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.416653 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de852c0-7e8d-4299-9e0a-089aec7c8827 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.416920 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de852c0-7e8d-4299-9e0a-089aec7c8827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.425273 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fc0e8-95fb-4eb4-8a0a-dc4a3858d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.425938 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fc0e8-95fb-4eb4-8a0a-dc4a3858d901 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.426217 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fc0e8-95fb-4eb4-8a0a-dc4a3858d901 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.426499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fc0e8-95fb-4eb4-8a0a-dc4a3858d901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.427346 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fc0e8-95fb-4eb4-8a0a-dc4a3858d901 None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=3c366d0b41ee4632b6ba0c3bb11511f3) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:48.427664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fc0e8-95fb-4eb4-8a0a-dc4a3858d901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.428505 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de852c0-7e8d-4299-9e0a-089aec7c8827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.429096 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fc0e8-95fb-4eb4-8a0a-dc4a3858d901 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.430335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de852c0-7e8d-4299-9e0a-089aec7c8827 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.434536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 272/528] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/role_assignments?user.id=3c366d0b41ee4632b6ba0c3bb11511f3&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:48.435310 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fc0e8-95fb-4eb4-8a0a-dc4a3858d901 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-7de852c0-7e8d-4299-9e0a-089aec7c8827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:48.457569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:48.458514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:48.459359 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:48.459359 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:48.459359 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:48.459359 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:48.461836 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 257/529] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:48.463248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de852c0-7e8d-4299-9e0a-089aec7c8827 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.547767 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.591025 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fc0e8-95fb-4eb4-8a0a-dc4a3858d901 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.601909 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de852c0-7e8d-4299-9e0a-089aec7c8827 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.606674 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.631880 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b4f50-f303-4071-9f28-9dacc4f5d12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.632838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b4f50-f303-4071-9f28-9dacc4f5d12f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.633117 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b4f50-f303-4071-9f28-9dacc4f5d12f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.633441 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b4f50-f303-4071-9f28-9dacc4f5d12f None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.634385 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b4f50-f303-4071-9f28-9dacc4f5d12f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:48.634704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b4f50-f303-4071-9f28-9dacc4f5d12f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.636719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b4f50-f303-4071-9f28-9dacc4f5d12f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.640289 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032f54f-04de-4f45-8eb8-9f4cd48624b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.641144 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032f54f-04de-4f45-8eb8-9f4cd48624b9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.641647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032f54f-04de-4f45-8eb8-9f4cd48624b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.642089 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032f54f-04de-4f45-8eb8-9f4cd48624b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.653336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 273/530] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:48.654477 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b4f50-f303-4071-9f28-9dacc4f5d12f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.719251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032f54f-04de-4f45-8eb8-9f4cd48624b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.721065 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032f54f-04de-4f45-8eb8-9f4cd48624b9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.776023 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.791566 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b4f50-f303-4071-9f28-9dacc4f5d12f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.826260 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 258/531] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:48.827427 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032f54f-04de-4f45-8eb8-9f4cd48624b9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.831880 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f863d-5584-4ad1-890c-ae40435c6709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.832564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f863d-5584-4ad1-890c-ae40435c6709 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.832853 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f863d-5584-4ad1-890c-ae40435c6709 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.833124 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f863d-5584-4ad1-890c-ae40435c6709 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.833891 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f863d-5584-4ad1-890c-ae40435c6709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:48.834198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f863d-5584-4ad1-890c-ae40435c6709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.835581 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f863d-5584-4ad1-890c-ae40435c6709 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.849300 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 274/532] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:48.854601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f863d-5584-4ad1-890c-ae40435c6709 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.887925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.933962 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032f54f-04de-4f45-8eb8-9f4cd48624b9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.965923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f863d-5584-4ad1-890c-ae40435c6709 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.969399 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d15fb-b6f9-40ae-a100-9be81534550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.970288 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d15fb-b6f9-40ae-a100-9be81534550c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.970805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d15fb-b6f9-40ae-a100-9be81534550c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.971265 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d15fb-b6f9-40ae-a100-9be81534550c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.972287 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d15fb-b6f9-40ae-a100-9be81534550c None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=808b08d1d2df42e587279071a5dba593) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:48.972832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d15fb-b6f9-40ae-a100-9be81534550c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.974590 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d15fb-b6f9-40ae-a100-9be81534550c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.981403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 259/533] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/role_assignments?user.id=808b08d1d2df42e587279071a5dba593&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:48.982456 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d15fb-b6f9-40ae-a100-9be81534550c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.013686 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.029820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef4890-43a6-4cb2-afbf-9747b86dcbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.030673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef4890-43a6-4cb2-afbf-9747b86dcbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.030951 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef4890-43a6-4cb2-afbf-9747b86dcbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.031225 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef4890-43a6-4cb2-afbf-9747b86dcbb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.056029 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef4890-43a6-4cb2-afbf-9747b86dcbb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.057590 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef4890-43a6-4cb2-afbf-9747b86dcbb3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-a7ef4890-43a6-4cb2-afbf-9747b86dcbb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:49.087773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:49.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:49.089564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:49.089564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:49.089564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:49.089564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:49.095846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d15fb-b6f9-40ae-a100-9be81534550c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.097697 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 275/534] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:49.103249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef4890-43a6-4cb2-afbf-9747b86dcbb3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.134083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d367a0-a16b-4e87-b8d9-249b2b8fdf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.135295 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d367a0-a16b-4e87-b8d9-249b2b8fdf57 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.135844 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d367a0-a16b-4e87-b8d9-249b2b8fdf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.136310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d367a0-a16b-4e87-b8d9-249b2b8fdf57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.150805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d367a0-a16b-4e87-b8d9-249b2b8fdf57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.152898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d367a0-a16b-4e87-b8d9-249b2b8fdf57 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-17d367a0-a16b-4e87-b8d9-249b2b8fdf57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:49.176544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:49.177480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:49.178344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:49.178344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:49.178344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:49.178344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:49.178344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:49.178344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:49.178344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:49.178344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:49.180927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 260/535] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:49.186188 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d367a0-a16b-4e87-b8d9-249b2b8fdf57 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.285622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.297793 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d367a0-a16b-4e87-b8d9-249b2b8fdf57 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.319247 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.331399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef4890-43a6-4cb2-afbf-9747b86dcbb3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.362647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb214184-e79d-4de2-9427-5b73fc44d411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.363247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb214184-e79d-4de2-9427-5b73fc44d411 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.363525 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb214184-e79d-4de2-9427-5b73fc44d411 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.363799 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb214184-e79d-4de2-9427-5b73fc44d411 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.364603 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb214184-e79d-4de2-9427-5b73fc44d411 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:49.364973 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb214184-e79d-4de2-9427-5b73fc44d411 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.366328 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac3eb4-230c-48a5-b33a-71e62546f98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.366779 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb214184-e79d-4de2-9427-5b73fc44d411 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.367647 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac3eb4-230c-48a5-b33a-71e62546f98b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.368155 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac3eb4-230c-48a5-b33a-71e62546f98b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.368622 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac3eb4-230c-48a5-b33a-71e62546f98b None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.369585 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac3eb4-230c-48a5-b33a-71e62546f98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:49.370087 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac3eb4-230c-48a5-b33a-71e62546f98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.371658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac3eb4-230c-48a5-b33a-71e62546f98b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.384662 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 276/536] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:49.390629 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac3eb4-230c-48a5-b33a-71e62546f98b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.403309 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 261/537] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:49.408838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb214184-e79d-4de2-9427-5b73fc44d411 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.564620 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb214184-e79d-4de2-9427-5b73fc44d411 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.592694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac3eb4-230c-48a5-b33a-71e62546f98b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.610736 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee27a-db8d-4804-a139-62c2dceefdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.611791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee27a-db8d-4804-a139-62c2dceefdeb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.612074 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee27a-db8d-4804-a139-62c2dceefdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.612347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee27a-db8d-4804-a139-62c2dceefdeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.613286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee27a-db8d-4804-a139-62c2dceefdeb None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=e0dae91953bf4a84883723bf3639e377) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:49.613547 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee27a-db8d-4804-a139-62c2dceefdeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.615573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee27a-db8d-4804-a139-62c2dceefdeb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.623934 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 262/538] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/role_assignments?user.id=e0dae91953bf4a84883723bf3639e377&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:49.624257 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.626451 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98341f1f-b16f-4345-83d3-4e28fa32eca9 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.626779 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98341f1f-b16f-4345-83d3-4e28fa32eca9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.627047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98341f1f-b16f-4345-83d3-4e28fa32eca9 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.632711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 263/539] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:49.634503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f441a6-abdc-4a2f-ba19-e8cbefba98ae None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.634807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f441a6-abdc-4a2f-ba19-e8cbefba98ae None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.635066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f441a6-abdc-4a2f-ba19-e8cbefba98ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.635533 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49521210-cab2-46f0-a2bd-8c0c2c91689d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.636636 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49521210-cab2-46f0-a2bd-8c0c2c91689d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.637176 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49521210-cab2-46f0-a2bd-8c0c2c91689d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.637833 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49521210-cab2-46f0-a2bd-8c0c2c91689d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.646351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49521210-cab2-46f0-a2bd-8c0c2c91689d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.648182 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49521210-cab2-46f0-a2bd-8c0c2c91689d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.655220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-13f441a6-abdc-4a2f-ba19-e8cbefba98ae None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:49.656430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-13f441a6-abdc-4a2f-ba19-e8cbefba98ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-49521210-cab2-46f0-a2bd-8c0c2c91689d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:49.663631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:49.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:49.665468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:49.665468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:49.665468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:49.665468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:49.665468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:49.665468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:49.665468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:49.665468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:49.668195 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 277/540] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:49.674348 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49521210-cab2-46f0-a2bd-8c0c2c91689d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.680049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.741466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 264/541] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:49.761179 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f441a6-abdc-4a2f-ba19-e8cbefba98ae None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.803392 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49521210-cab2-46f0-a2bd-8c0c2c91689d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.850161 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf28c21-ffff-4a83-96e4-56c8370a99e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.851002 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf28c21-ffff-4a83-96e4-56c8370a99e9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.851413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf28c21-ffff-4a83-96e4-56c8370a99e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.851699 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf28c21-ffff-4a83-96e4-56c8370a99e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.852518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf28c21-ffff-4a83-96e4-56c8370a99e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:49.852832 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf28c21-ffff-4a83-96e4-56c8370a99e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.855156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf28c21-ffff-4a83-96e4-56c8370a99e9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.876203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 278/542] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:49.879534 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf28c21-ffff-4a83-96e4-56c8370a99e9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.880721 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f441a6-abdc-4a2f-ba19-e8cbefba98ae None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.921772 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.928359 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a8870-81c6-49d4-ac35-0d54e7717a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.929590 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a8870-81c6-49d4-ac35-0d54e7717a0c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.930086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a8870-81c6-49d4-ac35-0d54e7717a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.930560 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a8870-81c6-49d4-ac35-0d54e7717a0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.944366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a8870-81c6-49d4-ac35-0d54e7717a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-045a8870-81c6-49d4-ac35-0d54e7717a0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:49.952642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:49.953946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:49.954729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:49.954729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:49.954729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:49.954729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:49.954729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:49.954729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:49.954729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:49.954729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:49.954729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:49.954729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:49.954729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:49.954729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:49.957021 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 265/543] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:49.959304 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.963429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a8870-81c6-49d4-ac35-0d54e7717a0c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.008452 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf28c21-ffff-4a83-96e4-56c8370a99e9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.060159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f3ee0-4fbb-492a-8bc7-b0398b9165e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:50.061258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f3ee0-4fbb-492a-8bc7-b0398b9165e0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.061685 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f3ee0-4fbb-492a-8bc7-b0398b9165e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.062505 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f3ee0-4fbb-492a-8bc7-b0398b9165e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.063839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f3ee0-4fbb-492a-8bc7-b0398b9165e0 None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=6c87c6bb14d74884a8c4ff8915d2494e) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:50.064297 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f3ee0-4fbb-492a-8bc7-b0398b9165e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.066442 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f3ee0-4fbb-492a-8bc7-b0398b9165e0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.081277 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 279/544] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/role_assignments?user.id=6c87c6bb14d74884a8c4ff8915d2494e&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:50.104451 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a8870-81c6-49d4-ac35-0d54e7717a0c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.161798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c26a8-4c51-4a90-aeda-d3f7556048e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:50.162630 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c26a8-4c51-4a90-aeda-d3f7556048e2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.163054 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c26a8-4c51-4a90-aeda-d3f7556048e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.163416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c26a8-4c51-4a90-aeda-d3f7556048e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.164316 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c26a8-4c51-4a90-aeda-d3f7556048e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:50.164731 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c26a8-4c51-4a90-aeda-d3f7556048e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.166258 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c26a8-4c51-4a90-aeda-d3f7556048e2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.182412 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 266/545] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:50.190557 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f3ee0-4fbb-492a-8bc7-b0398b9165e0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.356110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f3ee0-4fbb-492a-8bc7-b0398b9165e0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.385308 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:50.394907 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9466e7a-9f5e-4dc5-abbb-d87ec507e845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:50.395984 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9466e7a-9f5e-4dc5-abbb-d87ec507e845 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.396568 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9466e7a-9f5e-4dc5-abbb-d87ec507e845 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.397102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9466e7a-9f5e-4dc5-abbb-d87ec507e845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.408875 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9466e7a-9f5e-4dc5-abbb-d87ec507e845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.410571 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9466e7a-9f5e-4dc5-abbb-d87ec507e845 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-a9466e7a-9f5e-4dc5-abbb-d87ec507e845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:50.428367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:50.429474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:50.430521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:50.430521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:50.430521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:50.430521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:50.432405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 280/546] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:50.437788 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c26a8-4c51-4a90-aeda-d3f7556048e2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.529180 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:50.588681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c26a8-4c51-4a90-aeda-d3f7556048e2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.602369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30d774-56ac-48ad-b266-8b1835e9e9b8 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.602657 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30d774-56ac-48ad-b266-8b1835e9e9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.602935 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30d774-56ac-48ad-b266-8b1835e9e9b8 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.605635 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 281/547] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:50.609492 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcba61-2a72-4a94-830c-687e0a052c29 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.609810 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcba61-2a72-4a94-830c-687e0a052c29 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.610088 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcba61-2a72-4a94-830c-687e0a052c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.624310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab7f0a-a7a2-4c8e-8b2d-b79d85768226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:50.625321 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab7f0a-a7a2-4c8e-8b2d-b79d85768226 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.625902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab7f0a-a7a2-4c8e-8b2d-b79d85768226 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.626358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab7f0a-a7a2-4c8e-8b2d-b79d85768226 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.627507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab7f0a-a7a2-4c8e-8b2d-b79d85768226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:50.627942 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fbdcba61-2a72-4a94-830c-687e0a052c29 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:50.628158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab7f0a-a7a2-4c8e-8b2d-b79d85768226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.629139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fbdcba61-2a72-4a94-830c-687e0a052c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:50.629931 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab7f0a-a7a2-4c8e-8b2d-b79d85768226 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.643658 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 267/548] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:50.651144 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab7f0a-a7a2-4c8e-8b2d-b79d85768226 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.756076 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 282/549] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:50.791284 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcba61-2a72-4a94-830c-687e0a052c29 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.828269 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab7f0a-a7a2-4c8e-8b2d-b79d85768226 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.862672 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:50.905414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438e133-1eec-4dfe-8145-1dc76fb308fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:50.906699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438e133-1eec-4dfe-8145-1dc76fb308fe None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.908195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438e133-1eec-4dfe-8145-1dc76fb308fe None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.908663 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438e133-1eec-4dfe-8145-1dc76fb308fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.922353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438e133-1eec-4dfe-8145-1dc76fb308fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.923869 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438e133-1eec-4dfe-8145-1dc76fb308fe None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.946236 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcba61-2a72-4a94-830c-687e0a052c29 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-0438e133-1eec-4dfe-8145-1dc76fb308fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:50.949591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:50.951018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:50.952084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:50.952084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:50.952084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:50.952084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:50.952084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:50.952084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:50.952084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:50.952084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:50.952084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:52:50.952084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:50.952084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 268/550] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:50.956672 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438e133-1eec-4dfe-8145-1dc76fb308fe None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.963067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:51.013098 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d806ca-b33d-4250-8261-79e317def743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.014760 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d806ca-b33d-4250-8261-79e317def743 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.015387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d806ca-b33d-4250-8261-79e317def743 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.015823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d806ca-b33d-4250-8261-79e317def743 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.038712 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d806ca-b33d-4250-8261-79e317def743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-27d806ca-b33d-4250-8261-79e317def743 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:51.049255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:51.050393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:51.051491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:51.051491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:51.051491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:51.051491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:51.051491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:51.051491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:51.051491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:51.051491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:51.051491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:51.051491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:51.051491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:51.051491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:51.057737 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 283/551] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:51.063886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d806ca-b33d-4250-8261-79e317def743 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:51.149944 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438e133-1eec-4dfe-8145-1dc76fb308fe None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:51.218807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a0523-0d01-4439-8202-d8136f61a80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.219771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a0523-0d01-4439-8202-d8136f61a80d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.220277 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a0523-0d01-4439-8202-d8136f61a80d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.221492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a0523-0d01-4439-8202-d8136f61a80d None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.223149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a0523-0d01-4439-8202-d8136f61a80d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:51.223758 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a0523-0d01-4439-8202-d8136f61a80d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:51.226303 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a0523-0d01-4439-8202-d8136f61a80d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:51.238734 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d806ca-b33d-4250-8261-79e317def743 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:51.265369 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 269/552] 10.222.0.43 () {56 vars in 1135 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:51.269535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a0523-0d01-4439-8202-d8136f61a80d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:51.308580 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be851a73-db08-477e-a589-7ea2465195de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.309534 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be851a73-db08-477e-a589-7ea2465195de None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.309978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be851a73-db08-477e-a589-7ea2465195de None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.310576 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be851a73-db08-477e-a589-7ea2465195de None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.312504 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be851a73-db08-477e-a589-7ea2465195de None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:51.312995 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be851a73-db08-477e-a589-7ea2465195de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:51.314718 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be851a73-db08-477e-a589-7ea2465195de None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:51.326526 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:51.333882 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 284/553] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:51.339333 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be851a73-db08-477e-a589-7ea2465195de None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:51.400522 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:51.459208 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a0523-0d01-4439-8202-d8136f61a80d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:51.492126 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be851a73-db08-477e-a589-7ea2465195de None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:51.494851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b55639-57d2-46cc-9b2c-ceb75a6c5b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.495779 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b55639-57d2-46cc-9b2c-ceb75a6c5b6c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.496261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b55639-57d2-46cc-9b2c-ceb75a6c5b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.496736 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b55639-57d2-46cc-9b2c-ceb75a6c5b6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.530596 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300ca0a-b633-4cf1-8535-171412b4cb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.531324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300ca0a-b633-4cf1-8535-171412b4cb44 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.531707 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300ca0a-b633-4cf1-8535-171412b4cb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.531984 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300ca0a-b633-4cf1-8535-171412b4cb44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.543971 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300ca0a-b633-4cf1-8535-171412b4cb44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:51.545498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300ca0a-b633-4cf1-8535-171412b4cb44 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-2300ca0a-b633-4cf1-8535-171412b4cb44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:51.566787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:51.567678 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:51.567678 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:51.567678 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:51.567678 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:51.572407 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 285/554] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:51.573961 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700ec45-ce1c-4253-a0c3-21dc128a9a4c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.574252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700ec45-ce1c-4253-a0c3-21dc128a9a4c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.574533 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700ec45-ce1c-4253-a0c3-21dc128a9a4c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.575041 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b55639-57d2-46cc-9b2c-ceb75a6c5b6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:51.576730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b55639-57d2-46cc-9b2c-ceb75a6c5b6c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:51.582352 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 286/555] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:51.582352 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700ec45-ce1c-4253-a0c3-21dc128a9a4c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:51.618066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:51.676656 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:51.698005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 270/556] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:51.698005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d935664-15f6-4e60-a458-49f27acf0084 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.698005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d935664-15f6-4e60-a458-49f27acf0084 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.698005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d935664-15f6-4e60-a458-49f27acf0084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.702756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700ec45-ce1c-4253-a0c3-21dc128a9a4c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:51.715475 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9d935664-15f6-4e60-a458-49f27acf0084 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:51.717308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9d935664-15f6-4e60-a458-49f27acf0084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:51.741929 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f605da-d214-4611-a4ce-bebce9ed0246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.743007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f605da-d214-4611-a4ce-bebce9ed0246 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.743298 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f605da-d214-4611-a4ce-bebce9ed0246 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.743573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f605da-d214-4611-a4ce-bebce9ed0246 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.744300 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f605da-d214-4611-a4ce-bebce9ed0246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:51.744604 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f605da-d214-4611-a4ce-bebce9ed0246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:51.746283 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f605da-d214-4611-a4ce-bebce9ed0246 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:51.764979 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 287/557] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:51.764979 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f605da-d214-4611-a4ce-bebce9ed0246 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:51.799195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 271/558] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:51.799985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d935664-15f6-4e60-a458-49f27acf0084 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:51.857982 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:51.881695 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f605da-d214-4611-a4ce-bebce9ed0246 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:51.899356 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d935664-15f6-4e60-a458-49f27acf0084 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:51.920635 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013a9b1-8c2b-4090-a296-a0094da85bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.921854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013a9b1-8c2b-4090-a296-a0094da85bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.922502 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013a9b1-8c2b-4090-a296-a0094da85bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.923103 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013a9b1-8c2b-4090-a296-a0094da85bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.934085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad4c26-2e13-469d-9771-3b94feb9c663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.934711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad4c26-2e13-469d-9771-3b94feb9c663 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.935233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad4c26-2e13-469d-9771-3b94feb9c663 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.935233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad4c26-2e13-469d-9771-3b94feb9c663 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.937394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013a9b1-8c2b-4090-a296-a0094da85bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:51.939855 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013a9b1-8c2b-4090-a296-a0094da85bc2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:51.942804 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad4c26-2e13-469d-9771-3b94feb9c663 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:51.943316 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:51.944406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad4c26-2e13-469d-9771-3b94feb9c663 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-dcad4c26-2e13-469d-9771-3b94feb9c663 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:51.959965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:51.960957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:51.962310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:51.962310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:51.962310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:51.962310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:51.962310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:51.962310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:51.962310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:51.962310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:51.962310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:52:51.962310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:51.965549 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 272/559] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:51.966374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad4c26-2e13-469d-9771-3b94feb9c663 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-e013a9b1-8c2b-4090-a296-a0094da85bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:51.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:51.968528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:51.969517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:51.969517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:51.969517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:51.969517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:51.973088 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 288/560] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:51.978288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013a9b1-8c2b-4090-a296-a0094da85bc2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.075047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad4c26-2e13-469d-9771-3b94feb9c663 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.096657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.109420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013a9b1-8c2b-4090-a296-a0094da85bc2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.112356 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba72f7-0e65-4371-9cf7-a3e155160ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.113750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba72f7-0e65-4371-9cf7-a3e155160ddb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.113895 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba72f7-0e65-4371-9cf7-a3e155160ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.114123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba72f7-0e65-4371-9cf7-a3e155160ddb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.125305 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba72f7-0e65-4371-9cf7-a3e155160ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b7ba72f7-0e65-4371-9cf7-a3e155160ddb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:52.133123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:52.134152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:52.135015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 273/561] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:52.135823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba72f7-0e65-4371-9cf7-a3e155160ddb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.150561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a16985-b855-4caf-88aa-5b1229571630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.151424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a16985-b855-4caf-88aa-5b1229571630 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.151536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a16985-b855-4caf-88aa-5b1229571630 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.151792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a16985-b855-4caf-88aa-5b1229571630 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.152645 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a16985-b855-4caf-88aa-5b1229571630 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:52.152957 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a16985-b855-4caf-88aa-5b1229571630 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.154473 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a16985-b855-4caf-88aa-5b1229571630 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.177289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 289/562] 10.222.0.43 () {56 vars in 1137 bytes} [Sun Jul 24 00:52:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:52.177289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbc7ea-c141-4dc0-9682-f7d80283e236 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.177289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbc7ea-c141-4dc0-9682-f7d80283e236 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.177289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbc7ea-c141-4dc0-9682-f7d80283e236 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.177289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 290/563] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:52.177289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbc7ea-c141-4dc0-9682-f7d80283e236 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.241337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba72f7-0e65-4371-9cf7-a3e155160ddb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.241573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.276955 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3afafb-6de9-406d-83e3-1f800af99cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.278007 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3afafb-6de9-406d-83e3-1f800af99cdc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.278508 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3afafb-6de9-406d-83e3-1f800af99cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.278938 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3afafb-6de9-406d-83e3-1f800af99cdc None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.279842 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3afafb-6de9-406d-83e3-1f800af99cdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:52.280298 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3afafb-6de9-406d-83e3-1f800af99cdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.281979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3afafb-6de9-406d-83e3-1f800af99cdc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.292325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbc7ea-c141-4dc0-9682-f7d80283e236 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.294896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 274/564] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:52.295880 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3afafb-6de9-406d-83e3-1f800af99cdc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.332159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faa5eb-182f-4366-89de-4bacb7f4810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.332896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faa5eb-182f-4366-89de-4bacb7f4810a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.333178 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faa5eb-182f-4366-89de-4bacb7f4810a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.333488 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faa5eb-182f-4366-89de-4bacb7f4810a None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.334244 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faa5eb-182f-4366-89de-4bacb7f4810a None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:52.334551 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faa5eb-182f-4366-89de-4bacb7f4810a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.335922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faa5eb-182f-4366-89de-4bacb7f4810a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.340992 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.349481 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 291/565] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:52.349481 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c1e7b-7515-4509-9a4c-a8e7240ca67a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.349481 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c1e7b-7515-4509-9a4c-a8e7240ca67a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.349481 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c1e7b-7515-4509-9a4c-a8e7240ca67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.363360 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-bc8c1e7b-7515-4509-9a4c-a8e7240ca67a None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:52.364555 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bc8c1e7b-7515-4509-9a4c-a8e7240ca67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:52.411244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3afafb-6de9-406d-83e3-1f800af99cdc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.437470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 292/566] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:52.438421 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c1e7b-7515-4509-9a4c-a8e7240ca67a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.456183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c14af1-8623-4e76-8eba-77643b5af758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.457278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c14af1-8623-4e76-8eba-77643b5af758 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.457769 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c14af1-8623-4e76-8eba-77643b5af758 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.458371 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c14af1-8623-4e76-8eba-77643b5af758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.470121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c14af1-8623-4e76-8eba-77643b5af758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.472264 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c14af1-8623-4e76-8eba-77643b5af758 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-53c14af1-8623-4e76-8eba-77643b5af758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:52.490673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:52.491748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:52.492625 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:52.492625 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:52.492625 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:52.492625 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:52.492845 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.496600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 275/567] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:52.497473 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c14af1-8623-4e76-8eba-77643b5af758 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.547189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c1e7b-7515-4509-9a4c-a8e7240ca67a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.583183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dcb0f-3a07-4eab-8593-738ed49769f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.583923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dcb0f-3a07-4eab-8593-738ed49769f1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.584203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dcb0f-3a07-4eab-8593-738ed49769f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.584478 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dcb0f-3a07-4eab-8593-738ed49769f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.591604 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dcb0f-3a07-4eab-8593-738ed49769f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.592736 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.593058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dcb0f-3a07-4eab-8593-738ed49769f1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.601576 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c14af1-8623-4e76-8eba-77643b5af758 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-367dcb0f-3a07-4eab-8593-738ed49769f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:52.606781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:52.607837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:52.608945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:52.608945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:52.608945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:52.608945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:52.608945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:52.608945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:52.608945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:52.608945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:52.608945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 293/568] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:52.609528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dcb0f-3a07-4eab-8593-738ed49769f1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.638735 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e2da7-7785-42ec-a0e7-b47e0f254c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.639539 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e2da7-7785-42ec-a0e7-b47e0f254c4d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.639820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e2da7-7785-42ec-a0e7-b47e0f254c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.640095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e2da7-7785-42ec-a0e7-b47e0f254c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.649941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e2da7-7785-42ec-a0e7-b47e0f254c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.651391 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e2da7-7785-42ec-a0e7-b47e0f254c4d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9f8e2da7-7785-42ec-a0e7-b47e0f254c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:52.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:52.669789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:52.670735 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:52.670735 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:52.670735 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:52.670735 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:52.670735 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 276/569] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:52.671761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240094f9-6852-428b-8628-f1a12c9f0bcc None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.672175 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240094f9-6852-428b-8628-f1a12c9f0bcc None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.672443 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240094f9-6852-428b-8628-f1a12c9f0bcc None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.673668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 277/570] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:52.678437 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240094f9-6852-428b-8628-f1a12c9f0bcc None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.714958 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dcb0f-3a07-4eab-8593-738ed49769f1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.722003 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.750201 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd2839-1baa-4e1b-b92d-065e52ead4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.751016 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd2839-1baa-4e1b-b92d-065e52ead4fc None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.751298 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd2839-1baa-4e1b-b92d-065e52ead4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.751573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd2839-1baa-4e1b-b92d-065e52ead4fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.761763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd2839-1baa-4e1b-b92d-065e52ead4fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-99fd2839-1baa-4e1b-b92d-065e52ead4fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:52.769611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:52.770602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:52.771642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 294/571] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:52.772423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd2839-1baa-4e1b-b92d-065e52ead4fc None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.783833 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240094f9-6852-428b-8628-f1a12c9f0bcc None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.819226 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3a844-e192-4496-88a8-2d91dbfd602d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.819991 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3a844-e192-4496-88a8-2d91dbfd602d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.820381 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3a844-e192-4496-88a8-2d91dbfd602d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.820731 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3a844-e192-4496-88a8-2d91dbfd602d None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.821612 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3a844-e192-4496-88a8-2d91dbfd602d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:52.821922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3a844-e192-4496-88a8-2d91dbfd602d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.823308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3a844-e192-4496-88a8-2d91dbfd602d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.839395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 278/572] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:52.839395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3a844-e192-4496-88a8-2d91dbfd602d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.842700 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.873646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd2839-1baa-4e1b-b92d-065e52ead4fc None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.906850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854cf0b-1081-4603-ac8d-897f01c4e0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.907518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854cf0b-1081-4603-ac8d-897f01c4e0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.907811 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854cf0b-1081-4603-ac8d-897f01c4e0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.908090 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854cf0b-1081-4603-ac8d-897f01c4e0e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.909528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854cf0b-1081-4603-ac8d-897f01c4e0e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:52.910029 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854cf0b-1081-4603-ac8d-897f01c4e0e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.912688 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854cf0b-1081-4603-ac8d-897f01c4e0e2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.924829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 295/573] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:52.926055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8034-bd82-4da6-9c14-ee9edc475fea None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.926339 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8034-bd82-4da6-9c14-ee9edc475fea None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.926609 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8034-bd82-4da6-9c14-ee9edc475fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.937720 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3a844-e192-4496-88a8-2d91dbfd602d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.943719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-80fc8034-bd82-4da6-9c14-ee9edc475fea None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:52.944905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-80fc8034-bd82-4da6-9c14-ee9edc475fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:52.965767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.972077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8eb8be-af63-4fab-b0dd-eda3b130d8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.972759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8eb8be-af63-4fab-b0dd-eda3b130d8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.973138 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8eb8be-af63-4fab-b0dd-eda3b130d8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.973464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8eb8be-af63-4fab-b0dd-eda3b130d8c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.974201 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8eb8be-af63-4fab-b0dd-eda3b130d8c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:52.974505 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8eb8be-af63-4fab-b0dd-eda3b130d8c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.975902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8eb8be-af63-4fab-b0dd-eda3b130d8c0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.987851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 279/574] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:52.988664 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8eb8be-af63-4fab-b0dd-eda3b130d8c0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.013462 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 296/575] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:53.014300 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8034-bd82-4da6-9c14-ee9edc475fea None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.062610 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.100394 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8eb8be-af63-4fab-b0dd-eda3b130d8c0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.112007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8034-bd82-4da6-9c14-ee9edc475fea None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.135467 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d083c-ad12-4bbf-83e3-63e585172f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.136172 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d083c-ad12-4bbf-83e3-63e585172f88 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.136454 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d083c-ad12-4bbf-83e3-63e585172f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.136722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d083c-ad12-4bbf-83e3-63e585172f88 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.137502 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d083c-ad12-4bbf-83e3-63e585172f88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:53.137805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d083c-ad12-4bbf-83e3-63e585172f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.139196 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d083c-ad12-4bbf-83e3-63e585172f88 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.146598 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311c9a4-87f2-491d-aa74-e08833178366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.147403 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311c9a4-87f2-491d-aa74-e08833178366 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.147689 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311c9a4-87f2-491d-aa74-e08833178366 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.147963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311c9a4-87f2-491d-aa74-e08833178366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.152044 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 280/576] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:53.152877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d083c-ad12-4bbf-83e3-63e585172f88 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311c9a4-87f2-491d-aa74-e08833178366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.156375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311c9a4-87f2-491d-aa74-e08833178366 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-e311c9a4-87f2-491d-aa74-e08833178366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:53.170229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:53.171122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:53.172049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:53.172049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:53.172049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:53.172049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:53.172049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:53.172049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:53.172049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:53.172049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:53.172049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 297/577] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:53.172546 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311c9a4-87f2-491d-aa74-e08833178366 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.190905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.253298 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d083c-ad12-4bbf-83e3-63e585172f88 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.270953 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311c9a4-87f2-491d-aa74-e08833178366 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.277098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.287334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40c84c-447e-4492-88cd-bb6095df818c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.288003 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40c84c-447e-4492-88cd-bb6095df818c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.288287 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40c84c-447e-4492-88cd-bb6095df818c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.288565 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40c84c-447e-4492-88cd-bb6095df818c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.289432 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40c84c-447e-4492-88cd-bb6095df818c None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=bd9e9ad3ecec40b9a3c88a5f2b8fdfe2) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:53.289746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40c84c-447e-4492-88cd-bb6095df818c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.291186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40c84c-447e-4492-88cd-bb6095df818c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.297069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 281/578] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/role_assignments?user.id=bd9e9ad3ecec40b9a3c88a5f2b8fdfe2&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:53.297874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40c84c-447e-4492-88cd-bb6095df818c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.317318 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d925a7-d475-44a3-a4a4-36a692c1c4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.318793 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d925a7-d475-44a3-a4a4-36a692c1c4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.319716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d925a7-d475-44a3-a4a4-36a692c1c4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d925a7-d475-44a3-a4a4-36a692c1c4f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.332504 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d925a7-d475-44a3-a4a4-36a692c1c4f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.335449 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d925a7-d475-44a3-a4a4-36a692c1c4f8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-f0d925a7-d475-44a3-a4a4-36a692c1c4f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:53.356696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:53.357807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:53.358779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:53.358779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:53.358779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:53.358779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:53.358779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:53.358779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:53.358779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:53.358779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:53.358779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:52:53.358779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:53.358779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 298/579] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:53.360609 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d925a7-d475-44a3-a4a4-36a692c1c4f8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.417457 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40c84c-447e-4492-88cd-bb6095df818c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.447998 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.455618 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e916825-3d65-4158-8d6d-706d71678ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.456453 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e916825-3d65-4158-8d6d-706d71678ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.456739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e916825-3d65-4158-8d6d-706d71678ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.457015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e916825-3d65-4158-8d6d-706d71678ee7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.468189 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e916825-3d65-4158-8d6d-706d71678ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:53.474104 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d925a7-d475-44a3-a4a4-36a692c1c4f8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-6e916825-3d65-4158-8d6d-706d71678ee7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:53.476036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:53.477466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 282/580] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:53.478339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e916825-3d65-4158-8d6d-706d71678ee7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.512825 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4935a95-0582-4215-94c3-af286f2d176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.513744 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4935a95-0582-4215-94c3-af286f2d176b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.514081 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4935a95-0582-4215-94c3-af286f2d176b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.514412 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4935a95-0582-4215-94c3-af286f2d176b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.525514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4935a95-0582-4215-94c3-af286f2d176b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.526983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4935a95-0582-4215-94c3-af286f2d176b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.530282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-d4935a95-0582-4215-94c3-af286f2d176b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:53.545751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:53.546715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:53.547690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:53.547690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:53.547690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:53.547690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:53.551724 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 299/581] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:53.552378 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4935a95-0582-4215-94c3-af286f2d176b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.587140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e916825-3d65-4158-8d6d-706d71678ee7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.623268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555d3e3-0536-4365-bc1a-dc45eb735afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.623858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d3e3-0536-4365-bc1a-dc45eb735afc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.624140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d3e3-0536-4365-bc1a-dc45eb735afc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.624417 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d3e3-0536-4365-bc1a-dc45eb735afc None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.625360 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555d3e3-0536-4365-bc1a-dc45eb735afc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:53.625672 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555d3e3-0536-4365-bc1a-dc45eb735afc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.627115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555d3e3-0536-4365-bc1a-dc45eb735afc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.639728 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 283/582] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:53.640602 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555d3e3-0536-4365-bc1a-dc45eb735afc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.668843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4935a95-0582-4215-94c3-af286f2d176b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.699374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.710239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a0c4-b4c5-48c2-a470-181122c9b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.710932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a0c4-b4c5-48c2-a470-181122c9b01e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.711217 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a0c4-b4c5-48c2-a470-181122c9b01e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.711854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a0c4-b4c5-48c2-a470-181122c9b01e None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.712713 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91a0c4-b4c5-48c2-a470-181122c9b01e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:53.713052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91a0c4-b4c5-48c2-a470-181122c9b01e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.714524 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91a0c4-b4c5-48c2-a470-181122c9b01e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.733482 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 300/583] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:53.734363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a0c4-b4c5-48c2-a470-181122c9b01e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.758928 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555d3e3-0536-4365-bc1a-dc45eb735afc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.771387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.797393 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf646e-dc8c-4199-a64f-996c39da046f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.798068 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf646e-dc8c-4199-a64f-996c39da046f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.798348 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf646e-dc8c-4199-a64f-996c39da046f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.798622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf646e-dc8c-4199-a64f-996c39da046f None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.799371 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf646e-dc8c-4199-a64f-996c39da046f None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:53.799677 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf646e-dc8c-4199-a64f-996c39da046f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.801195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf646e-dc8c-4199-a64f-996c39da046f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.809699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 284/584] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:53.810117 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf646e-dc8c-4199-a64f-996c39da046f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.843207 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a0c4-b4c5-48c2-a470-181122c9b01e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.878573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be333a8a-150f-4809-af43-03e2ac918add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.879184 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be333a8a-150f-4809-af43-03e2ac918add None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.879462 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be333a8a-150f-4809-af43-03e2ac918add None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.879807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be333a8a-150f-4809-af43-03e2ac918add None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.880441 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be333a8a-150f-4809-af43-03e2ac918add None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:53.880739 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be333a8a-150f-4809-af43-03e2ac918add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.882125 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be333a8a-150f-4809-af43-03e2ac918add None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.894019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 301/585] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:53.894830 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be333a8a-150f-4809-af43-03e2ac918add None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.917270 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf646e-dc8c-4199-a64f-996c39da046f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.946722 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.952429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9095e-8cc5-4cd9-86e9-598bfdf086af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.953465 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9095e-8cc5-4cd9-86e9-598bfdf086af None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.953749 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9095e-8cc5-4cd9-86e9-598bfdf086af None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.954022 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9095e-8cc5-4cd9-86e9-598bfdf086af None admin] PATH_INFO: `/v3/projects/f5b7f081bd694cce90cca76194df476e/users/3c366d0b41ee4632b6ba0c3bb11511f3/roles/ce064f563f9340c9863b6ec5bb273c39` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.975013 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9095e-8cc5-4cd9-86e9-598bfdf086af None admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7f081bd694cce90cca76194df476e, user_id=3c366d0b41ee4632b6ba0c3bb11511f3, role_id=ce064f563f9340c9863b6ec5bb273c39)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.976497 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9095e-8cc5-4cd9-86e9-598bfdf086af None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.991864 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 285/586] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:53 2022] PUT /identity/v3/projects/f5b7f081bd694cce90cca76194df476e/users/3c366d0b41ee4632b6ba0c3bb11511f3/roles/ce064f563f9340c9863b6ec5bb273c39 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:53.992577 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9095e-8cc5-4cd9-86e9-598bfdf086af None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.020783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.034448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be333a8a-150f-4809-af43-03e2ac918add None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.076558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95b3f9-d6bc-4c18-8ebf-cc79de68aac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.077415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95b3f9-d6bc-4c18-8ebf-cc79de68aac0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.077704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95b3f9-d6bc-4c18-8ebf-cc79de68aac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.078160 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95b3f9-d6bc-4c18-8ebf-cc79de68aac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.091369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95b3f9-d6bc-4c18-8ebf-cc79de68aac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.092974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95b3f9-d6bc-4c18-8ebf-cc79de68aac0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-5c95b3f9-d6bc-4c18-8ebf-cc79de68aac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:54.112111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:54.113082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:54.114622 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:54.114622 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:54.114622 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:54.114622 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:54.114622 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 302/587] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:54.114956 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95b3f9-d6bc-4c18-8ebf-cc79de68aac0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.120759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9095e-8cc5-4cd9-86e9-598bfdf086af None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.168013 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a01c7-ea49-4f17-aa80-c9d08e381f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.169119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a01c7-ea49-4f17-aa80-c9d08e381f89 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.169439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a01c7-ea49-4f17-aa80-c9d08e381f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.169726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a01c7-ea49-4f17-aa80-c9d08e381f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.182240 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a01c7-ea49-4f17-aa80-c9d08e381f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.183806 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a01c7-ea49-4f17-aa80-c9d08e381f89 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-d21a01c7-ea49-4f17-aa80-c9d08e381f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:54.202492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:54.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:54.204406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:54.204406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:54.204406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:54.204406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:54.208876 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 286/588] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:54.209761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a01c7-ea49-4f17-aa80-c9d08e381f89 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.232909 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.239013 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95b3f9-d6bc-4c18-8ebf-cc79de68aac0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.290228 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67c304-9437-4075-a9d8-e8c69df3b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.291151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67c304-9437-4075-a9d8-e8c69df3b641 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.291500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67c304-9437-4075-a9d8-e8c69df3b641 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.291844 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67c304-9437-4075-a9d8-e8c69df3b641 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.294190 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.305383 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67c304-9437-4075-a9d8-e8c69df3b641 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.307412 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67c304-9437-4075-a9d8-e8c69df3b641 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.321642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a01c7-ea49-4f17-aa80-c9d08e381f89 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-1f67c304-9437-4075-a9d8-e8c69df3b641 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:54.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:54.328354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:54.329652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:54.329652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:54.329652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:54.329652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:54.329652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:54.329652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:54.329652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:54.329652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:54.329652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:52:54.329652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:54.329652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 303/589] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:54.334497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67c304-9437-4075-a9d8-e8c69df3b641 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.362949 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6193bd-c463-48ec-947c-19c3a5b08955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.363621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6193bd-c463-48ec-947c-19c3a5b08955 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.363903 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6193bd-c463-48ec-947c-19c3a5b08955 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.364179 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6193bd-c463-48ec-947c-19c3a5b08955 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.364902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6193bd-c463-48ec-947c-19c3a5b08955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:54.365231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6193bd-c463-48ec-947c-19c3a5b08955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.366695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6193bd-c463-48ec-947c-19c3a5b08955 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.379334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 287/590] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:54.380309 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6193bd-c463-48ec-947c-19c3a5b08955 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.447774 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67c304-9437-4075-a9d8-e8c69df3b641 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.484135 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7e37-3abf-4ca0-a61a-122153281e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.485661 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7e37-3abf-4ca0-a61a-122153281e8e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.486148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7e37-3abf-4ca0-a61a-122153281e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.486640 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7e37-3abf-4ca0-a61a-122153281e8e None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.486926 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6193bd-c463-48ec-947c-19c3a5b08955 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.488082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd7e37-3abf-4ca0-a61a-122153281e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:54.488602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd7e37-3abf-4ca0-a61a-122153281e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.490231 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd7e37-3abf-4ca0-a61a-122153281e8e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.503118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 304/591] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:54.504295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7e37-3abf-4ca0-a61a-122153281e8e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.526658 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76763eed-de8d-44c9-a79f-e25067683b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.527338 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76763eed-de8d-44c9-a79f-e25067683b95 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.527616 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76763eed-de8d-44c9-a79f-e25067683b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.527891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76763eed-de8d-44c9-a79f-e25067683b95 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.528310 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.528768 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76763eed-de8d-44c9-a79f-e25067683b95 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:54.529048 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76763eed-de8d-44c9-a79f-e25067683b95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.530524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76763eed-de8d-44c9-a79f-e25067683b95 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.532561 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.551123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 288/592] 10.222.0.43 () {56 vars in 1139 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:54.555959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76763eed-de8d-44c9-a79f-e25067683b95 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.636016 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7e37-3abf-4ca0-a61a-122153281e8e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.674703 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394dffb-0e10-4728-bcba-f4a1ae1d1978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.675808 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394dffb-0e10-4728-bcba-f4a1ae1d1978 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.676204 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394dffb-0e10-4728-bcba-f4a1ae1d1978 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.676472 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394dffb-0e10-4728-bcba-f4a1ae1d1978 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.683880 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394dffb-0e10-4728-bcba-f4a1ae1d1978 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.686067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394dffb-0e10-4728-bcba-f4a1ae1d1978 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-3394dffb-0e10-4728-bcba-f4a1ae1d1978 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:54.700764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:54.701698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:54.702584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:54.702584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:54.702584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:54.702584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:54.702584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:54.702584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:54.702584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:54.702584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:54.702584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 305/593] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:54.703246 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394dffb-0e10-4728-bcba-f4a1ae1d1978 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.720853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76763eed-de8d-44c9-a79f-e25067683b95 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.781021 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d0e2e-afdf-47dd-803f-0d72b3362089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.782971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d0e2e-afdf-47dd-803f-0d72b3362089 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.783541 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d0e2e-afdf-47dd-803f-0d72b3362089 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.784055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d0e2e-afdf-47dd-803f-0d72b3362089 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.800793 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d0e2e-afdf-47dd-803f-0d72b3362089 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.802751 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d0e2e-afdf-47dd-803f-0d72b3362089 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.803714 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-337d0e2e-afdf-47dd-803f-0d72b3362089 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:54.824933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:54.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:54.826922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:54.826922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:54.826922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:54.826922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:54.826922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:54.826922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:54.826922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:54.826922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:54.826922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:52:54.826922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:54.833439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 289/594] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:54.834552 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d0e2e-afdf-47dd-803f-0d72b3362089 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.846437 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394dffb-0e10-4728-bcba-f4a1ae1d1978 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.895757 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b44e8-d9a0-4222-b04d-423fba556472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.896595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b44e8-d9a0-4222-b04d-423fba556472 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.896876 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b44e8-d9a0-4222-b04d-423fba556472 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.897148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b44e8-d9a0-4222-b04d-423fba556472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.908722 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b44e8-d9a0-4222-b04d-423fba556472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.910199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b44e8-d9a0-4222-b04d-423fba556472 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.925120 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-d29b44e8-d9a0-4222-b04d-423fba556472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:54.932074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:54.932993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:54.933940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:54.933940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:54.933940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:54.933940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:54.939296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 306/595] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:54.941243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b44e8-d9a0-4222-b04d-423fba556472 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.016411 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d0e2e-afdf-47dd-803f-0d72b3362089 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.072251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c733a50-5721-4368-a585-e412fad7db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.073802 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c733a50-5721-4368-a585-e412fad7db3b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.074522 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c733a50-5721-4368-a585-e412fad7db3b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.074967 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c733a50-5721-4368-a585-e412fad7db3b None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.076175 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c733a50-5721-4368-a585-e412fad7db3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:55.077153 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c733a50-5721-4368-a585-e412fad7db3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.079117 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c733a50-5721-4368-a585-e412fad7db3b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.097005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b44e8-d9a0-4222-b04d-423fba556472 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.101722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 290/596] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:55.102830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c733a50-5721-4368-a585-e412fad7db3b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.157800 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:55.172561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ee856-cd59-4230-8d12-32a69bb8a724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.174332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ee856-cd59-4230-8d12-32a69bb8a724 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.175639 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ee856-cd59-4230-8d12-32a69bb8a724 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.176484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ee856-cd59-4230-8d12-32a69bb8a724 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.177928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ee856-cd59-4230-8d12-32a69bb8a724 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:55.179440 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ee856-cd59-4230-8d12-32a69bb8a724 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.181510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ee856-cd59-4230-8d12-32a69bb8a724 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.222064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 307/597] 10.222.0.43 () {56 vars in 1137 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:55.223465 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ee856-cd59-4230-8d12-32a69bb8a724 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.274701 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c733a50-5721-4368-a585-e412fad7db3b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.304327 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:55.338663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ee856-cd59-4230-8d12-32a69bb8a724 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.339649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aad321-7c3c-4aeb-898e-a3c15195b9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.340326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aad321-7c3c-4aeb-898e-a3c15195b9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.340607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aad321-7c3c-4aeb-898e-a3c15195b9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.340877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aad321-7c3c-4aeb-898e-a3c15195b9c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.341634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aad321-7c3c-4aeb-898e-a3c15195b9c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:55.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aad321-7c3c-4aeb-898e-a3c15195b9c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.343314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aad321-7c3c-4aeb-898e-a3c15195b9c6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.356132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 291/598] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:55.357297 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aad321-7c3c-4aeb-898e-a3c15195b9c6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.378201 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99755eb4-e15f-4697-bc18-dd6ce31ee3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.379103 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99755eb4-e15f-4697-bc18-dd6ce31ee3e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99755eb4-e15f-4697-bc18-dd6ce31ee3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.379659 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99755eb4-e15f-4697-bc18-dd6ce31ee3e3 None admin] PATH_INFO: `/v3/projects/f5b7f081bd694cce90cca76194df476e/users/808b08d1d2df42e587279071a5dba593/roles/ce064f563f9340c9863b6ec5bb273c39` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.394298 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99755eb4-e15f-4697-bc18-dd6ce31ee3e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7f081bd694cce90cca76194df476e, user_id=808b08d1d2df42e587279071a5dba593, role_id=ce064f563f9340c9863b6ec5bb273c39)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.395735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99755eb4-e15f-4697-bc18-dd6ce31ee3e3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.409717 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 308/599] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:55 2022] PUT /identity/v3/projects/f5b7f081bd694cce90cca76194df476e/users/808b08d1d2df42e587279071a5dba593/roles/ce064f563f9340c9863b6ec5bb273c39 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:55.411018 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612344ef-229b-4346-a004-41e7571b7222 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.411306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612344ef-229b-4346-a004-41e7571b7222 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.411581 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612344ef-229b-4346-a004-41e7571b7222 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.413076 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 309/600] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:55.418010 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612344ef-229b-4346-a004-41e7571b7222 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.464919 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:55.483837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aad321-7c3c-4aeb-898e-a3c15195b9c6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.527838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcc4f3-c689-4e54-8260-1dc983af4c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.528630 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcc4f3-c689-4e54-8260-1dc983af4c0e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.528913 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcc4f3-c689-4e54-8260-1dc983af4c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.529192 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcc4f3-c689-4e54-8260-1dc983af4c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.540262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612344ef-229b-4346-a004-41e7571b7222 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.544453 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcc4f3-c689-4e54-8260-1dc983af4c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.546007 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcc4f3-c689-4e54-8260-1dc983af4c0e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-a9dcc4f3-c689-4e54-8260-1dc983af4c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:55.573851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:55.574823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:55.575731 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:55.575731 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:55.575731 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:55.575731 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:55.575731 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 292/601] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:55.576896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9346eb9-6cc3-4d37-9be2-6b7b54073a03 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.577191 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9346eb9-6cc3-4d37-9be2-6b7b54073a03 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.577501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9346eb9-6cc3-4d37-9be2-6b7b54073a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.587995 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb6a3b-d053-4fd0-9e46-e73db320b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.589269 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6a3b-d053-4fd0-9e46-e73db320b691 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.589750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6a3b-d053-4fd0-9e46-e73db320b691 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.590235 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb6a3b-d053-4fd0-9e46-e73db320b691 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.598723 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb6a3b-d053-4fd0-9e46-e73db320b691 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.598935 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b9346eb9-6cc3-4d37-9be2-6b7b54073a03 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:55.600232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b9346eb9-6cc3-4d37-9be2-6b7b54073a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:55.600688 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb6a3b-d053-4fd0-9e46-e73db320b691 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-71cb6a3b-d053-4fd0-9e46-e73db320b691 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:55.617719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:55.618914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:55.620031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:55.620031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:55.620031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:55.620031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:55.620031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:55.620031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:55.620031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:55.620031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:55.621247 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 310/602] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:55.622238 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb6a3b-d053-4fd0-9e46-e73db320b691 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.623533 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:55.682340 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 293/603] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:55.689230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9346eb9-6cc3-4d37-9be2-6b7b54073a03 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.746948 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:55.751775 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb6a3b-d053-4fd0-9e46-e73db320b691 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.788868 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b17f4-979f-44b9-a6dd-4be935fbe4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.789934 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b17f4-979f-44b9-a6dd-4be935fbe4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.790419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b17f4-979f-44b9-a6dd-4be935fbe4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.790834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b17f4-979f-44b9-a6dd-4be935fbe4c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.791738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b17f4-979f-44b9-a6dd-4be935fbe4c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:55.792324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b17f4-979f-44b9-a6dd-4be935fbe4c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.793751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b17f4-979f-44b9-a6dd-4be935fbe4c9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.806154 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9346eb9-6cc3-4d37-9be2-6b7b54073a03 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.811159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 311/604] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:55.811159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b17f4-979f-44b9-a6dd-4be935fbe4c9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.852709 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc6fd8-7491-45cb-bf53-e775636ddf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.854255 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc6fd8-7491-45cb-bf53-e775636ddf20 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.854680 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc6fd8-7491-45cb-bf53-e775636ddf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.855096 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc6fd8-7491-45cb-bf53-e775636ddf20 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.856467 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc6fd8-7491-45cb-bf53-e775636ddf20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:55.856922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc6fd8-7491-45cb-bf53-e775636ddf20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.859347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc6fd8-7491-45cb-bf53-e775636ddf20 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.880784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 294/605] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:55.880784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc6fd8-7491-45cb-bf53-e775636ddf20 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.902107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:55.926133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b17f4-979f-44b9-a6dd-4be935fbe4c9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.961966 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbcf8d-4cd7-4f5b-be10-9336e604e203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.963267 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbcf8d-4cd7-4f5b-be10-9336e604e203 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.963664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbcf8d-4cd7-4f5b-be10-9336e604e203 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.964031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbcf8d-4cd7-4f5b-be10-9336e604e203 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.975452 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbcf8d-4cd7-4f5b-be10-9336e604e203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-8efbcf8d-4cd7-4f5b-be10-9336e604e203 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:55.983702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:55.984687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:55.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:55.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:55.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:55.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:55.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:55.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:55.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:55.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:55.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:55.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:55.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:55.985567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:55.990267 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 312/606] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:55.991160 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbcf8d-4cd7-4f5b-be10-9336e604e203 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.011479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc6fd8-7491-45cb-bf53-e775636ddf20 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.012755 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.055955 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d23647-7be5-4e8b-b333-7f4d5af787e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.057760 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d23647-7be5-4e8b-b333-7f4d5af787e9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.058530 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d23647-7be5-4e8b-b333-7f4d5af787e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.059003 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d23647-7be5-4e8b-b333-7f4d5af787e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.069917 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d23647-7be5-4e8b-b333-7f4d5af787e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.072814 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d23647-7be5-4e8b-b333-7f4d5af787e9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-09d23647-7be5-4e8b-b333-7f4d5af787e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:56.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:56.092747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:56.093778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:56.093778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:56.093778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:56.093778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:56.093778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:56.093778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:56.093778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:56.093778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:56.097348 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 295/607] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:56.098356 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d23647-7be5-4e8b-b333-7f4d5af787e9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.110929 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbcf8d-4cd7-4f5b-be10-9336e604e203 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.146709 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502b5e6-8ba2-4527-b25c-51775b5e4f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.147612 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502b5e6-8ba2-4527-b25c-51775b5e4f63 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.147891 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502b5e6-8ba2-4527-b25c-51775b5e4f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.148162 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502b5e6-8ba2-4527-b25c-51775b5e4f63 None admin] PATH_INFO: `/v3/projects/f5b7f081bd694cce90cca76194df476e/users/e0dae91953bf4a84883723bf3639e377/roles/ce064f563f9340c9863b6ec5bb273c39` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.163627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502b5e6-8ba2-4527-b25c-51775b5e4f63 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7f081bd694cce90cca76194df476e, user_id=e0dae91953bf4a84883723bf3639e377, role_id=ce064f563f9340c9863b6ec5bb273c39)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.165230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502b5e6-8ba2-4527-b25c-51775b5e4f63 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.180296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 313/608] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:55 2022] PUT /identity/v3/projects/f5b7f081bd694cce90cca76194df476e/users/e0dae91953bf4a84883723bf3639e377/roles/ce064f563f9340c9863b6ec5bb273c39 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:56.181722 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502b5e6-8ba2-4527-b25c-51775b5e4f63 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.189184 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.223738 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d23647-7be5-4e8b-b333-7f4d5af787e9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.264501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15e084-14e4-4a1e-aa69-aa6327178e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.265240 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15e084-14e4-4a1e-aa69-aa6327178e72 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.265555 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15e084-14e4-4a1e-aa69-aa6327178e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.265921 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15e084-14e4-4a1e-aa69-aa6327178e72 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.266708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15e084-14e4-4a1e-aa69-aa6327178e72 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:56.267261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.267655 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15e084-14e4-4a1e-aa69-aa6327178e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.269114 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15e084-14e4-4a1e-aa69-aa6327178e72 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.283930 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 296/609] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:56.285835 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109454b-4a97-4061-9845-3df89519e87a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.286322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109454b-4a97-4061-9845-3df89519e87a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.286909 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109454b-4a97-4061-9845-3df89519e87a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.293647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 297/610] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:56.294912 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109454b-4a97-4061-9845-3df89519e87a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.332938 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502b5e6-8ba2-4527-b25c-51775b5e4f63 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.375045 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a77783-5af6-408c-ae14-d9dec6a781b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.375727 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77783-5af6-408c-ae14-d9dec6a781b3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.376395 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77783-5af6-408c-ae14-d9dec6a781b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.376395 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77783-5af6-408c-ae14-d9dec6a781b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.377039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a77783-5af6-408c-ae14-d9dec6a781b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:56.378606 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a77783-5af6-408c-ae14-d9dec6a781b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.379944 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a77783-5af6-408c-ae14-d9dec6a781b3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.391711 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 314/611] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:56.394494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f6311-3c8c-477e-9fef-5cafe0ee646f None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.394781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f6311-3c8c-477e-9fef-5cafe0ee646f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.395053 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f6311-3c8c-477e-9fef-5cafe0ee646f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.413849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ee4f6311-3c8c-477e-9fef-5cafe0ee646f None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:56.415042 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ee4f6311-3c8c-477e-9fef-5cafe0ee646f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:56.423979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109454b-4a97-4061-9845-3df89519e87a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.469951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec56f7-94b6-4f3f-ac15-3c74d5611707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.471613 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec56f7-94b6-4f3f-ac15-3c74d5611707 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.472335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec56f7-94b6-4f3f-ac15-3c74d5611707 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.472783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec56f7-94b6-4f3f-ac15-3c74d5611707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.476990 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.485469 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 315/612] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:56.486433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f6311-3c8c-477e-9fef-5cafe0ee646f None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.490706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec56f7-94b6-4f3f-ac15-3c74d5611707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.492399 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec56f7-94b6-4f3f-ac15-3c74d5611707 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-11ec56f7-94b6-4f3f-ac15-3c74d5611707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:56.519716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:56.520654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:56.521588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:56.521588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:56.521588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:56.521588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:56.522674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 298/613] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:56.526015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec56f7-94b6-4f3f-ac15-3c74d5611707 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.552784 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.597009 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f6311-3c8c-477e-9fef-5cafe0ee646f None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.637939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a4449-27e3-4afe-8eda-2805f978ffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.638941 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a4449-27e3-4afe-8eda-2805f978ffb2 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.639344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a4449-27e3-4afe-8eda-2805f978ffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.639712 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a4449-27e3-4afe-8eda-2805f978ffb2 None admin] PATH_INFO: `/v3/projects/f5b7f081bd694cce90cca76194df476e/users/6c87c6bb14d74884a8c4ff8915d2494e/roles/ce064f563f9340c9863b6ec5bb273c39` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.655055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a4449-27e3-4afe-8eda-2805f978ffb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7f081bd694cce90cca76194df476e, user_id=6c87c6bb14d74884a8c4ff8915d2494e, role_id=ce064f563f9340c9863b6ec5bb273c39)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.656713 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a4449-27e3-4afe-8eda-2805f978ffb2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.657886 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec56f7-94b6-4f3f-ac15-3c74d5611707 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.677307 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 316/614] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:56 2022] PUT /identity/v3/projects/f5b7f081bd694cce90cca76194df476e/users/6c87c6bb14d74884a8c4ff8915d2494e/roles/ce064f563f9340c9863b6ec5bb273c39 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:56.678300 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a4449-27e3-4afe-8eda-2805f978ffb2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.734587 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063c9a5-2ff7-451c-8102-1b10a0882a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.735679 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063c9a5-2ff7-451c-8102-1b10a0882a62 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.736146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063c9a5-2ff7-451c-8102-1b10a0882a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.736579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063c9a5-2ff7-451c-8102-1b10a0882a62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.762920 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063c9a5-2ff7-451c-8102-1b10a0882a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-a063c9a5-2ff7-451c-8102-1b10a0882a62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:56.780430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:56.781598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:56.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 299/615] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:56.788206 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063c9a5-2ff7-451c-8102-1b10a0882a62 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.848688 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a4449-27e3-4afe-8eda-2805f978ffb2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.865628 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.887919 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.903318 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a334bc1-f4d1-43f5-a294-0b25180576fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.904031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a334bc1-f4d1-43f5-a294-0b25180576fc None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.904319 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a334bc1-f4d1-43f5-a294-0b25180576fc None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.904703 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a334bc1-f4d1-43f5-a294-0b25180576fc None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.905485 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a334bc1-f4d1-43f5-a294-0b25180576fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:56.905849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a334bc1-f4d1-43f5-a294-0b25180576fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.907283 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a334bc1-f4d1-43f5-a294-0b25180576fc None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.921831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 317/616] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:56.927859 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a334bc1-f4d1-43f5-a294-0b25180576fc None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.951896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063c9a5-2ff7-451c-8102-1b10a0882a62 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.996255 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a075381-a6c5-4ffc-9d59-a8fe4b97de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.997340 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a075381-a6c5-4ffc-9d59-a8fe4b97de40 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.997754 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a075381-a6c5-4ffc-9d59-a8fe4b97de40 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.998041 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a075381-a6c5-4ffc-9d59-a8fe4b97de40 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.998828 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a075381-a6c5-4ffc-9d59-a8fe4b97de40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:56.999139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a075381-a6c5-4ffc-9d59-a8fe4b97de40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.000600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a075381-a6c5-4ffc-9d59-a8fe4b97de40 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.009818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 300/617] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:57.018287 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a075381-a6c5-4ffc-9d59-a8fe4b97de40 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.049182 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a334bc1-f4d1-43f5-a294-0b25180576fc None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.087879 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b81b61-e943-4cb1-8ac0-4a074e2d77c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.089347 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81b61-e943-4cb1-8ac0-4a074e2d77c0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.089804 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81b61-e943-4cb1-8ac0-4a074e2d77c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.090244 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81b61-e943-4cb1-8ac0-4a074e2d77c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.100936 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b81b61-e943-4cb1-8ac0-4a074e2d77c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.102655 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b81b61-e943-4cb1-8ac0-4a074e2d77c0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-c5b81b61-e943-4cb1-8ac0-4a074e2d77c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:57.119305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:57.120285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:57.121254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:57.121254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:57.121254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:57.121254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:57.121254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:57.121254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:57.121254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:57.121254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:57.121254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:52:57.121254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:57.123804 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 318/618] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:57.130187 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b81b61-e943-4cb1-8ac0-4a074e2d77c0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.186719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:57.229433 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a075381-a6c5-4ffc-9d59-a8fe4b97de40 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.253590 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:57.292647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479509e-b4c3-4e8a-a288-dcb165044538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.293760 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479509e-b4c3-4e8a-a288-dcb165044538 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.294129 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479509e-b4c3-4e8a-a288-dcb165044538 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.294470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479509e-b4c3-4e8a-a288-dcb165044538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.305720 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479509e-b4c3-4e8a-a288-dcb165044538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.307356 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479509e-b4c3-4e8a-a288-dcb165044538 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.319300 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b81b61-e943-4cb1-8ac0-4a074e2d77c0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f479509e-b4c3-4e8a-a288-dcb165044538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:57.324710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:57.325803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:57.327051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:57.327051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:57.327051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:57.327051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:57.327881 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 301/619] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:57.333536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479509e-b4c3-4e8a-a288-dcb165044538 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.396209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525088c1-6cf0-4934-a5df-7105437be614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.396919 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525088c1-6cf0-4934-a5df-7105437be614 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.397214 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525088c1-6cf0-4934-a5df-7105437be614 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.397503 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525088c1-6cf0-4934-a5df-7105437be614 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.398360 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525088c1-6cf0-4934-a5df-7105437be614 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:57.398669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525088c1-6cf0-4934-a5df-7105437be614 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.400117 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525088c1-6cf0-4934-a5df-7105437be614 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.439925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 319/620] 10.222.0.43 () {56 vars in 1135 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:57.442048 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525088c1-6cf0-4934-a5df-7105437be614 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.499844 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479509e-b4c3-4e8a-a288-dcb165044538 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.561117 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6f5bb-4871-406e-9399-f027f5a5b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.561833 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f5bb-4871-406e-9399-f027f5a5b506 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.562174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f5bb-4871-406e-9399-f027f5a5b506 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.562454 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f5bb-4871-406e-9399-f027f5a5b506 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.563197 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6f5bb-4871-406e-9399-f027f5a5b506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:57.563505 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6f5bb-4871-406e-9399-f027f5a5b506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.564923 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6f5bb-4871-406e-9399-f027f5a5b506 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.588309 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 302/621] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:57.588624 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:57.598346 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6f5bb-4871-406e-9399-f027f5a5b506 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.615953 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525088c1-6cf0-4934-a5df-7105437be614 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.634947 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:57.659381 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593649fa-3ad4-4662-be4d-7e470cd3b662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.660747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593649fa-3ad4-4662-be4d-7e470cd3b662 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.661256 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593649fa-3ad4-4662-be4d-7e470cd3b662 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.661757 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593649fa-3ad4-4662-be4d-7e470cd3b662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.673390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593649fa-3ad4-4662-be4d-7e470cd3b662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.675192 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593649fa-3ad4-4662-be4d-7e470cd3b662 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-593649fa-3ad4-4662-be4d-7e470cd3b662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:57.694121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:57.695043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:57.695975 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:57.695975 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:57.695975 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:57.695975 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:57.698400 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 320/622] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:57.699902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc800beb-9d5a-4d43-81be-8552132ba163 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.700395 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc800beb-9d5a-4d43-81be-8552132ba163 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.700965 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc800beb-9d5a-4d43-81be-8552132ba163 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.706957 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 321/623] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:57.708070 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc800beb-9d5a-4d43-81be-8552132ba163 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.713587 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6f5bb-4871-406e-9399-f027f5a5b506 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.747853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75714e-c868-4a2f-9dbc-18f9b58802f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.748655 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75714e-c868-4a2f-9dbc-18f9b58802f8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.748935 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75714e-c868-4a2f-9dbc-18f9b58802f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.749227 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75714e-c868-4a2f-9dbc-18f9b58802f8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.756436 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75714e-c868-4a2f-9dbc-18f9b58802f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.757906 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75714e-c868-4a2f-9dbc-18f9b58802f8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-4b75714e-c868-4a2f-9dbc-18f9b58802f8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:57.772221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:57.773224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:57.774220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:57.774220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:57.774220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:57.774220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:57.774220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:57.774220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:57.774220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:57.774220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:57.774220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:52:57.774220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:57.778064 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 303/624] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:57.779305 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8155a86-80d9-41a2-ab9e-3906aa760c5c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.779590 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8155a86-80d9-41a2-ab9e-3906aa760c5c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.779863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8155a86-80d9-41a2-ab9e-3906aa760c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.797275 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e8155a86-80d9-41a2-ab9e-3906aa760c5c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:57.798502 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e8155a86-80d9-41a2-ab9e-3906aa760c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:57.825761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc800beb-9d5a-4d43-81be-8552132ba163 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.863575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb21593-7954-4a32-a579-8c20290a4e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.869229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb21593-7954-4a32-a579-8c20290a4e6c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.869350 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 304/625] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:57.869350 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8155a86-80d9-41a2-ab9e-3906aa760c5c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.870083 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb21593-7954-4a32-a579-8c20290a4e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.870578 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb21593-7954-4a32-a579-8c20290a4e6c None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.871549 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb21593-7954-4a32-a579-8c20290a4e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:57.872055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb21593-7954-4a32-a579-8c20290a4e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.873855 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb21593-7954-4a32-a579-8c20290a4e6c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.886301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:57.890880 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:57.898036 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 322/626] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:57.903402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb21593-7954-4a32-a579-8c20290a4e6c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.970168 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8155a86-80d9-41a2-ab9e-3906aa760c5c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.008038 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0909ac0-2e54-4032-a932-ebcd5cc29cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.008856 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0909ac0-2e54-4032-a932-ebcd5cc29cbd None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.009141 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0909ac0-2e54-4032-a932-ebcd5cc29cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.009440 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0909ac0-2e54-4032-a932-ebcd5cc29cbd None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.010489 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0909ac0-2e54-4032-a932-ebcd5cc29cbd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:58.010698 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0909ac0-2e54-4032-a932-ebcd5cc29cbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.012257 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0909ac0-2e54-4032-a932-ebcd5cc29cbd None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.020532 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb21593-7954-4a32-a579-8c20290a4e6c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.035743 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 305/627] 10.222.0.43 () {56 vars in 1137 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:58.035743 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0909ac0-2e54-4032-a932-ebcd5cc29cbd None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.062074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967cc0d-a78e-4ad8-b70b-201994e195bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.063294 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967cc0d-a78e-4ad8-b70b-201994e195bc None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.063778 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967cc0d-a78e-4ad8-b70b-201994e195bc None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.064313 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967cc0d-a78e-4ad8-b70b-201994e195bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.072155 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967cc0d-a78e-4ad8-b70b-201994e195bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.073918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967cc0d-a78e-4ad8-b70b-201994e195bc None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-f967cc0d-a78e-4ad8-b70b-201994e195bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:58.089702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:58.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:58.091529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:58.091529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:58.091529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:58.091529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:58.091529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:58.091529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:58.091529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:58.091529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:58.094319 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 323/628] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:58.095319 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967cc0d-a78e-4ad8-b70b-201994e195bc None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.108024 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.140995 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0909ac0-2e54-4032-a932-ebcd5cc29cbd None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.160632 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.180606 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb20c1-ea43-4a1c-be34-447888dfd253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.181758 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb20c1-ea43-4a1c-be34-447888dfd253 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.182043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb20c1-ea43-4a1c-be34-447888dfd253 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.182317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb20c1-ea43-4a1c-be34-447888dfd253 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.193756 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb20c1-ea43-4a1c-be34-447888dfd253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-32eb20c1-ea43-4a1c-be34-447888dfd253 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:58.202029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:58.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:58.203863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:58.203863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:58.203863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:58.203863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:58.203863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:58.203863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:58.203863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:58.203863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:58.203863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:58.203863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:58.203863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:58.203863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:58.208218 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 306/629] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:58.209176 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb20c1-ea43-4a1c-be34-447888dfd253 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.215231 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967cc0d-a78e-4ad8-b70b-201994e195bc None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.251616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd01b7-49db-45e5-926c-f103b7515f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.252717 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd01b7-49db-45e5-926c-f103b7515f53 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.253224 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd01b7-49db-45e5-926c-f103b7515f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.253700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd01b7-49db-45e5-926c-f103b7515f53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.313656 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb20c1-ea43-4a1c-be34-447888dfd253 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.325752 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd01b7-49db-45e5-926c-f103b7515f53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.327665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd01b7-49db-45e5-926c-f103b7515f53 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.343287 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.349474 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a35c3-8a05-4075-ada6-29d60c692a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.350365 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a35c3-8a05-4075-ada6-29d60c692a59 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.351201 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a35c3-8a05-4075-ada6-29d60c692a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.351912 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a35c3-8a05-4075-ada6-29d60c692a59 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.353167 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a35c3-8a05-4075-ada6-29d60c692a59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:58.353469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a35c3-8a05-4075-ada6-29d60c692a59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.355284 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a35c3-8a05-4075-ada6-29d60c692a59 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.369545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 307/630] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:58.370667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a35c3-8a05-4075-ada6-29d60c692a59 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.392905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.455500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 324/631] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:58.456633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd01b7-49db-45e5-926c-f103b7515f53 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.499657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a35c3-8a05-4075-ada6-29d60c692a59 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.542155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020f342-d6ed-4326-8c20-1d56602e241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.542760 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020f342-d6ed-4326-8c20-1d56602e241c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.543041 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020f342-d6ed-4326-8c20-1d56602e241c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.543331 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020f342-d6ed-4326-8c20-1d56602e241c None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.544517 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020f342-d6ed-4326-8c20-1d56602e241c None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:58.544829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020f342-d6ed-4326-8c20-1d56602e241c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.546681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020f342-d6ed-4326-8c20-1d56602e241c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.562188 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 308/632] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:58.562188 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020f342-d6ed-4326-8c20-1d56602e241c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.571363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd01b7-49db-45e5-926c-f103b7515f53 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.613479 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf1765-11fe-4adc-b2f7-4f6eaa9a0acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.614384 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf1765-11fe-4adc-b2f7-4f6eaa9a0acd None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.614673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf1765-11fe-4adc-b2f7-4f6eaa9a0acd None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.614947 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf1765-11fe-4adc-b2f7-4f6eaa9a0acd None admin] PATH_INFO: `/v3/projects/f5b7f081bd694cce90cca76194df476e/users/bd9e9ad3ecec40b9a3c88a5f2b8fdfe2/roles/ce064f563f9340c9863b6ec5bb273c39` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.616147 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.632347 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf1765-11fe-4adc-b2f7-4f6eaa9a0acd None admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7f081bd694cce90cca76194df476e, user_id=bd9e9ad3ecec40b9a3c88a5f2b8fdfe2, role_id=ce064f563f9340c9863b6ec5bb273c39)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.633807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf1765-11fe-4adc-b2f7-4f6eaa9a0acd None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.647648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 325/633] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:58 2022] PUT /identity/v3/projects/f5b7f081bd694cce90cca76194df476e/users/bd9e9ad3ecec40b9a3c88a5f2b8fdfe2/roles/ce064f563f9340c9863b6ec5bb273c39 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:58.649138 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36069631-c10c-4a23-8aec-c36762ca1613 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.649465 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36069631-c10c-4a23-8aec-c36762ca1613 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.649742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36069631-c10c-4a23-8aec-c36762ca1613 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.651162 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 326/634] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:58.656628 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36069631-c10c-4a23-8aec-c36762ca1613 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.674379 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.677606 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020f342-d6ed-4326-8c20-1d56602e241c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.720092 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d8a22-6535-4f00-902c-e3ec0ef45025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.721887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d8a22-6535-4f00-902c-e3ec0ef45025 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.722426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d8a22-6535-4f00-902c-e3ec0ef45025 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.722946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d8a22-6535-4f00-902c-e3ec0ef45025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.735854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d8a22-6535-4f00-902c-e3ec0ef45025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.737876 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d8a22-6535-4f00-902c-e3ec0ef45025 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-134d8a22-6535-4f00-902c-e3ec0ef45025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:58.757329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:58.758293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:58.759191 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:58.759191 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:58.759191 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:58.759191 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:58.766228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 309/635] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:58.768095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4b06b-351f-48f8-a4d6-3badbd5fc90d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.768624 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4b06b-351f-48f8-a4d6-3badbd5fc90d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.769102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4b06b-351f-48f8-a4d6-3badbd5fc90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.788803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-07d4b06b-351f-48f8-a4d6-3badbd5fc90d None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:58.790478 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-07d4b06b-351f-48f8-a4d6-3badbd5fc90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:58.793081 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36069631-c10c-4a23-8aec-c36762ca1613 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.843157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cc3f8-03ac-4450-aab4-646827aafbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.844494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cc3f8-03ac-4450-aab4-646827aafbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.844784 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cc3f8-03ac-4450-aab4-646827aafbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.845065 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cc3f8-03ac-4450-aab4-646827aafbd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.856682 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cc3f8-03ac-4450-aab4-646827aafbd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.858320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cc3f8-03ac-4450-aab4-646827aafbd9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.886243 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 310/636] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:58.887559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4b06b-351f-48f8-a4d6-3badbd5fc90d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-d00cc3f8-03ac-4450-aab4-646827aafbd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:58.890389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:58.891295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:58.892191 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:58.892191 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:58.892191 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:58.892191 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:58.894882 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 327/637] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:58.905229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cc3f8-03ac-4450-aab4-646827aafbd9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.941379 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.972400 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.009185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4b06b-351f-48f8-a4d6-3badbd5fc90d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.015860 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cc3f8-03ac-4450-aab4-646827aafbd9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.044405 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42afa0-8e88-4339-ab71-f527e24df2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.044996 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42afa0-8e88-4339-ab71-f527e24df2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.045314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42afa0-8e88-4339-ab71-f527e24df2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.045670 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42afa0-8e88-4339-ab71-f527e24df2a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.046347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42afa0-8e88-4339-ab71-f527e24df2a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:59.046650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42afa0-8e88-4339-ab71-f527e24df2a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.048012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42afa0-8e88-4339-ab71-f527e24df2a4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.056237 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a763b-7b4d-406b-8528-f3fb2233b537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.056980 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a763b-7b4d-406b-8528-f3fb2233b537 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.057298 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a763b-7b4d-406b-8528-f3fb2233b537 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.057544 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a763b-7b4d-406b-8528-f3fb2233b537 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.058294 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a763b-7b4d-406b-8528-f3fb2233b537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:59.058595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a763b-7b4d-406b-8528-f3fb2233b537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.060219 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a763b-7b4d-406b-8528-f3fb2233b537 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.060338 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 311/638] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:59.065240 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42afa0-8e88-4339-ab71-f527e24df2a4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.076258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 328/639] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:59.076258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7f636-f655-42f6-9d86-9b531aaddfc1 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.076258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7f636-f655-42f6-9d86-9b531aaddfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.076258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7f636-f655-42f6-9d86-9b531aaddfc1 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.076258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 329/640] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:59.076258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7f636-f655-42f6-9d86-9b531aaddfc1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.170674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.178987 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42afa0-8e88-4339-ab71-f527e24df2a4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.185550 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7f636-f655-42f6-9d86-9b531aaddfc1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.207946 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.221848 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ad611-01dd-4000-81e2-274b6c237b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.222663 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ad611-01dd-4000-81e2-274b6c237b68 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.222947 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ad611-01dd-4000-81e2-274b6c237b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.223222 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ad611-01dd-4000-81e2-274b6c237b68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.231454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa6a15-e934-4a14-a523-c7f64fd7e332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.232265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa6a15-e934-4a14-a523-c7f64fd7e332 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.232558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa6a15-e934-4a14-a523-c7f64fd7e332 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.232870 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa6a15-e934-4a14-a523-c7f64fd7e332 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.239939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa6a15-e934-4a14-a523-c7f64fd7e332 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.241280 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ad611-01dd-4000-81e2-274b6c237b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:59.241565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa6a15-e934-4a14-a523-c7f64fd7e332 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-488ad611-01dd-4000-81e2-274b6c237b68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:59.249304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:59.250235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:59.251091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 312/641] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:59.252044 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ad611-01dd-4000-81e2-274b6c237b68 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-65fa6a15-e934-4a14-a523-c7f64fd7e332 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:59.255911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:59.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:59.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:59.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:59.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:59.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:59.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:59.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:59.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:59.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:59.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 330/642] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:59.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66252f-23fc-4587-811a-05183d1eaf2a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66252f-23fc-4587-811a-05183d1eaf2a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.259510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66252f-23fc-4587-811a-05183d1eaf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.276438 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5c66252f-23fc-4587-811a-05183d1eaf2a None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:59.277912 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5c66252f-23fc-4587-811a-05183d1eaf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:59.349773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 331/643] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:59.350925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66252f-23fc-4587-811a-05183d1eaf2a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.373949 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ad611-01dd-4000-81e2-274b6c237b68 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.409897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83500825-6243-4251-b226-4f3cba2ae2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.410703 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83500825-6243-4251-b226-4f3cba2ae2ee None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.410984 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83500825-6243-4251-b226-4f3cba2ae2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.411258 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83500825-6243-4251-b226-4f3cba2ae2ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.419577 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83500825-6243-4251-b226-4f3cba2ae2ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.421046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83500825-6243-4251-b226-4f3cba2ae2ee None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-83500825-6243-4251-b226-4f3cba2ae2ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:59.436771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:59.438006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:59.439008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:59.439008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:59.439008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:59.439008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:59.439008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:59.439008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:59.439008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:59.439008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:59.439008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:52:59.439008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:52:59.439008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 313/644] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:59.439008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83500825-6243-4251-b226-4f3cba2ae2ee None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.457770 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.462337 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66252f-23fc-4587-811a-05183d1eaf2a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.473296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.499614 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8e46c-4035-40b4-9cca-bba2c90f9790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.500367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8e46c-4035-40b4-9cca-bba2c90f9790 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.500705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8e46c-4035-40b4-9cca-bba2c90f9790 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.501055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8e46c-4035-40b4-9cca-bba2c90f9790 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.501891 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8e46c-4035-40b4-9cca-bba2c90f9790 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:59.502199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8e46c-4035-40b4-9cca-bba2c90f9790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.503574 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8e46c-4035-40b4-9cca-bba2c90f9790 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.516535 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 332/645] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:59.516535 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8e46c-4035-40b4-9cca-bba2c90f9790 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.550234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83500825-6243-4251-b226-4f3cba2ae2ee None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.595574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bc12a-46fc-4773-b17f-663b6d5e25f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.596251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bc12a-46fc-4773-b17f-663b6d5e25f3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.596573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bc12a-46fc-4773-b17f-663b6d5e25f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.596815 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bc12a-46fc-4773-b17f-663b6d5e25f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.597644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bc12a-46fc-4773-b17f-663b6d5e25f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:59.597956 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bc12a-46fc-4773-b17f-663b6d5e25f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.599394 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bc12a-46fc-4773-b17f-663b6d5e25f3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.611666 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 314/646] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:59.614371 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bc12a-46fc-4773-b17f-663b6d5e25f3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.625506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8e46c-4035-40b4-9cca-bba2c90f9790 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.660650 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4787c2-de22-4afa-bee2-b458943700ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.661495 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4787c2-de22-4afa-bee2-b458943700ca None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.661782 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4787c2-de22-4afa-bee2-b458943700ca None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.662056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4787c2-de22-4afa-bee2-b458943700ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.672625 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4787c2-de22-4afa-bee2-b458943700ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-5f4787c2-de22-4afa-bee2-b458943700ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:59.680398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:59.681376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:59.682251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 333/647] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:59.682958 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4787c2-de22-4afa-bee2-b458943700ca None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.701899 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.716173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.730762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bc12a-46fc-4773-b17f-663b6d5e25f3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.767764 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191b455-c3be-4aa1-bf0d-1a5a2533da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.768535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191b455-c3be-4aa1-bf0d-1a5a2533da68 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.768887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191b455-c3be-4aa1-bf0d-1a5a2533da68 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.769254 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191b455-c3be-4aa1-bf0d-1a5a2533da68 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.770104 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191b455-c3be-4aa1-bf0d-1a5a2533da68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:59.770411 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191b455-c3be-4aa1-bf0d-1a5a2533da68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.771870 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191b455-c3be-4aa1-bf0d-1a5a2533da68 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.793729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 315/648] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:59.793940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4787c2-de22-4afa-bee2-b458943700ca None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.794036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191b455-c3be-4aa1-bf0d-1a5a2533da68 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.830346 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0b444-dd41-43d9-a961-d2757ba4f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.831161 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0b444-dd41-43d9-a961-d2757ba4f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.831440 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0b444-dd41-43d9-a961-d2757ba4f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.831714 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0b444-dd41-43d9-a961-d2757ba4f0d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.843463 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0b444-dd41-43d9-a961-d2757ba4f0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.845017 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0b444-dd41-43d9-a961-d2757ba4f0d1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-53d0b444-dd41-43d9-a961-d2757ba4f0d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:59.862288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:59.863344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:59.864439 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:59.864439 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:59.864439 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:59.864439 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:52:59.868116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 334/649] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:59.869026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0b444-dd41-43d9-a961-d2757ba4f0d1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.901961 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191b455-c3be-4aa1-bf0d-1a5a2533da68 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.934973 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.941751 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fde48-4b3f-4997-9f95-61e63535d00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.942552 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fde48-4b3f-4997-9f95-61e63535d00b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.943650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fde48-4b3f-4997-9f95-61e63535d00b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.944022 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fde48-4b3f-4997-9f95-61e63535d00b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.946137 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fde48-4b3f-4997-9f95-61e63535d00b None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=3c366d0b41ee4632b6ba0c3bb11511f3) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:59.946454 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fde48-4b3f-4997-9f95-61e63535d00b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.947894 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fde48-4b3f-4997-9f95-61e63535d00b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.965237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 316/650] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/role_assignments?user.id=3c366d0b41ee4632b6ba0c3bb11511f3&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:59.965237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fde48-4b3f-4997-9f95-61e63535d00b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.971268 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.995961 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0b444-dd41-43d9-a961-d2757ba4f0d1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.047897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e842498-8550-4b89-a021-0ec190de42a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.048589 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e842498-8550-4b89-a021-0ec190de42a1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.048874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e842498-8550-4b89-a021-0ec190de42a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.049145 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e842498-8550-4b89-a021-0ec190de42a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.049936 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e842498-8550-4b89-a021-0ec190de42a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:00.050240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e842498-8550-4b89-a021-0ec190de42a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.051624 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e842498-8550-4b89-a021-0ec190de42a1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.062099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 335/651] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:00.062976 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e842498-8550-4b89-a021-0ec190de42a1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.077899 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fde48-4b3f-4997-9f95-61e63535d00b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.122729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d139-6959-4f94-876f-992d47b0f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.123360 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d139-6959-4f94-876f-992d47b0f953 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.123639 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d139-6959-4f94-876f-992d47b0f953 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.123908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d139-6959-4f94-876f-992d47b0f953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.183390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e842498-8550-4b89-a021-0ec190de42a1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.199090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.206488 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d139-6959-4f94-876f-992d47b0f953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.208430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d139-6959-4f94-876f-992d47b0f953 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.240725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928b197-ed34-42d8-b703-475d512aa3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.241685 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928b197-ed34-42d8-b703-475d512aa3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.242113 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928b197-ed34-42d8-b703-475d512aa3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.242538 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928b197-ed34-42d8-b703-475d512aa3a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.243447 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928b197-ed34-42d8-b703-475d512aa3a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:00.243755 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928b197-ed34-42d8-b703-475d512aa3a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.245132 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928b197-ed34-42d8-b703-475d512aa3a9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.258054 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 336/652] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:00.258950 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928b197-ed34-42d8-b703-475d512aa3a9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.268251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.346012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 317/653] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:00.346012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d139-6959-4f94-876f-992d47b0f953 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.369108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928b197-ed34-42d8-b703-475d512aa3a9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.405008 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ae54d-9cae-4026-bded-2f942ab8a035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.406014 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ae54d-9cae-4026-bded-2f942ab8a035 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.406162 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ae54d-9cae-4026-bded-2f942ab8a035 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.406431 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ae54d-9cae-4026-bded-2f942ab8a035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.418033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ae54d-9cae-4026-bded-2f942ab8a035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.419399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ae54d-9cae-4026-bded-2f942ab8a035 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-947ae54d-9cae-4026-bded-2f942ab8a035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:00.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:00.439343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:00.440447 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:00.440447 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:00.440447 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:00.440447 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:00.440447 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 337/654] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:00.440722 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ae54d-9cae-4026-bded-2f942ab8a035 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.467169 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.475900 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d139-6959-4f94-876f-992d47b0f953 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.507758 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.516396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71997cc0-9785-4a4c-9530-8659d4a7e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.517346 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71997cc0-9785-4a4c-9530-8659d4a7e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.517760 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71997cc0-9785-4a4c-9530-8659d4a7e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.518030 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71997cc0-9785-4a4c-9530-8659d4a7e8b6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.525892 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71997cc0-9785-4a4c-9530-8659d4a7e8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.527446 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71997cc0-9785-4a4c-9530-8659d4a7e8b6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-71997cc0-9785-4a4c-9530-8659d4a7e8b6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:00.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:00.544846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:00.546057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:00.546057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:00.546057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:00.546057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:00.546057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:00.546057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:00.546057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:00.546057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:00.546057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:53:00.546057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:00.547237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 318/655] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:00.548140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71997cc0-9785-4a4c-9530-8659d4a7e8b6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.561193 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ae54d-9cae-4026-bded-2f942ab8a035 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.607144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f9604-0444-46a1-9e3b-06ca4dd716a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.608300 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f9604-0444-46a1-9e3b-06ca4dd716a1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.608614 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f9604-0444-46a1-9e3b-06ca4dd716a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.609006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f9604-0444-46a1-9e3b-06ca4dd716a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.620632 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f9604-0444-46a1-9e3b-06ca4dd716a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.622379 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f9604-0444-46a1-9e3b-06ca4dd716a1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-238f9604-0444-46a1-9e3b-06ca4dd716a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:00.642262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:00.643854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:00.644980 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:00.644980 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:00.644980 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:00.644980 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:00.650057 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 338/656] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:00.650057 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f9604-0444-46a1-9e3b-06ca4dd716a1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.679445 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71997cc0-9785-4a4c-9530-8659d4a7e8b6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.727243 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c7818-7330-4d16-aa9d-be1d390022a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.728330 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c7818-7330-4d16-aa9d-be1d390022a5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.728711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c7818-7330-4d16-aa9d-be1d390022a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.729086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c7818-7330-4d16-aa9d-be1d390022a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.730545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c7818-7330-4d16-aa9d-be1d390022a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:00.730963 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c7818-7330-4d16-aa9d-be1d390022a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.732739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c7818-7330-4d16-aa9d-be1d390022a5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.749137 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 319/657] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:00.750568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c7818-7330-4d16-aa9d-be1d390022a5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.766790 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f9604-0444-46a1-9e3b-06ca4dd716a1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.774536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.778393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.803497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749010ee-2dcb-44db-9aea-f8bcc1ed0691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.804183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749010ee-2dcb-44db-9aea-f8bcc1ed0691 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.804468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749010ee-2dcb-44db-9aea-f8bcc1ed0691 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.804744 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749010ee-2dcb-44db-9aea-f8bcc1ed0691 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.805631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749010ee-2dcb-44db-9aea-f8bcc1ed0691 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:00.805942 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749010ee-2dcb-44db-9aea-f8bcc1ed0691 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.807376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749010ee-2dcb-44db-9aea-f8bcc1ed0691 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.829754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 339/658] 10.222.0.43 () {56 vars in 1139 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:00.829754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749010ee-2dcb-44db-9aea-f8bcc1ed0691 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.865008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c7818-7330-4d16-aa9d-be1d390022a5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.901996 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf85cbd-a4ab-446f-9f1b-6fd2c10591b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.902672 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf85cbd-a4ab-446f-9f1b-6fd2c10591b2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.902952 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf85cbd-a4ab-446f-9f1b-6fd2c10591b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.903224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf85cbd-a4ab-446f-9f1b-6fd2c10591b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.903958 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf85cbd-a4ab-446f-9f1b-6fd2c10591b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:00.904267 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf85cbd-a4ab-446f-9f1b-6fd2c10591b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.905712 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf85cbd-a4ab-446f-9f1b-6fd2c10591b2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.922831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 320/659] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:00.922831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9e040-4f03-42d9-9d9c-3eb3b83428fb None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.922831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9e040-4f03-42d9-9d9c-3eb3b83428fb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.922831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9e040-4f03-42d9-9d9c-3eb3b83428fb None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.922831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 321/660] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:00.922831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9e040-4f03-42d9-9d9c-3eb3b83428fb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.937327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749010ee-2dcb-44db-9aea-f8bcc1ed0691 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.971097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ec829-0452-4bd0-822d-2c046947d628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.971908 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ec829-0452-4bd0-822d-2c046947d628 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.972196 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ec829-0452-4bd0-822d-2c046947d628 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.972475 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ec829-0452-4bd0-822d-2c046947d628 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.979696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ec829-0452-4bd0-822d-2c046947d628 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.981134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ec829-0452-4bd0-822d-2c046947d628 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-a49ec829-0452-4bd0-822d-2c046947d628 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:00.995987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:00.997118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:00.998146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:00.998146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:00.998146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:00.998146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:00.998146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:00.998146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:00.998146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:00.998146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:00.998146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:53:00.998146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:00.998146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 340/661] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:00.998753 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ec829-0452-4bd0-822d-2c046947d628 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.009178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.029961 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.038006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9e040-4f03-42d9-9d9c-3eb3b83428fb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.077589 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b1709-391f-4369-99d9-86de58902b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.078256 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b1709-391f-4369-99d9-86de58902b9f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.078600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b1709-391f-4369-99d9-86de58902b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.078862 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b1709-391f-4369-99d9-86de58902b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.108790 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ec829-0452-4bd0-822d-2c046947d628 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.144865 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14ca84-8248-48f1-9f81-d54993a961af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.145682 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ca84-8248-48f1-9f81-d54993a961af None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.145963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ca84-8248-48f1-9f81-d54993a961af None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.146229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ca84-8248-48f1-9f81-d54993a961af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.150506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b1709-391f-4369-99d9-86de58902b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.152003 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b1709-391f-4369-99d9-86de58902b9f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.153578 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14ca84-8248-48f1-9f81-d54993a961af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.155024 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14ca84-8248-48f1-9f81-d54993a961af None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-bb14ca84-8248-48f1-9f81-d54993a961af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:01.169241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:01.170194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:01.171303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:01.171303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:01.171303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:01.171303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:01.171303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:01.171303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:01.171303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:01.171303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:01.171303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 341/662] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:01.172274 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39e482-96bf-4029-89d5-e30a52c53d13 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.172377 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39e482-96bf-4029-89d5-e30a52c53d13 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.172725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39e482-96bf-4029-89d5-e30a52c53d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.192690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7e39e482-96bf-4029-89d5-e30a52c53d13 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:01.193942 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7e39e482-96bf-4029-89d5-e30a52c53d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:01.251822 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.282267 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 322/663] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:01.282267 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b1709-391f-4369-99d9-86de58902b9f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.289364 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 342/664] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:01.293251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39e482-96bf-4029-89d5-e30a52c53d13 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.309979 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.383925 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b1709-391f-4369-99d9-86de58902b9f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.397686 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39e482-96bf-4029-89d5-e30a52c53d13 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.417959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43509abe-7dec-40a4-9e1a-e0d30d154b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.418619 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43509abe-7dec-40a4-9e1a-e0d30d154b5d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.418893 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43509abe-7dec-40a4-9e1a-e0d30d154b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.419161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43509abe-7dec-40a4-9e1a-e0d30d154b5d None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.420006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43509abe-7dec-40a4-9e1a-e0d30d154b5d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:01.420316 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43509abe-7dec-40a4-9e1a-e0d30d154b5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.421849 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43509abe-7dec-40a4-9e1a-e0d30d154b5d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.433099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd345b77-bb7d-48a4-9a75-78670d93b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.434038 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd345b77-bb7d-48a4-9a75-78670d93b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.434504 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd345b77-bb7d-48a4-9a75-78670d93b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.435076 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd345b77-bb7d-48a4-9a75-78670d93b0f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.435868 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd345b77-bb7d-48a4-9a75-78670d93b0f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:01.436181 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd345b77-bb7d-48a4-9a75-78670d93b0f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.437745 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd345b77-bb7d-48a4-9a75-78670d93b0f3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.443465 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 323/665] 10.222.0.43 () {56 vars in 1137 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:01.443465 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43509abe-7dec-40a4-9e1a-e0d30d154b5d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.459594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 343/666] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:01.459594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd345b77-bb7d-48a4-9a75-78670d93b0f3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.481352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.539034 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.554903 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43509abe-7dec-40a4-9e1a-e0d30d154b5d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.561423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd345b77-bb7d-48a4-9a75-78670d93b0f3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.597586 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945a29e-284e-47c6-b627-eb7a6850255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.598619 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945a29e-284e-47c6-b627-eb7a6850255d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.599148 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945a29e-284e-47c6-b627-eb7a6850255d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.599667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945a29e-284e-47c6-b627-eb7a6850255d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.601816 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f8ac-bd7c-4961-85ca-0e5bbbefc65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.603781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f8ac-bd7c-4961-85ca-0e5bbbefc65e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.603781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f8ac-bd7c-4961-85ca-0e5bbbefc65e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.603781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f8ac-bd7c-4961-85ca-0e5bbbefc65e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.612801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945a29e-284e-47c6-b627-eb7a6850255d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.613724 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71f8ac-bd7c-4961-85ca-0e5bbbefc65e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:01.614709 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945a29e-284e-47c6-b627-eb7a6850255d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-eb71f8ac-bd7c-4961-85ca-0e5bbbefc65e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:01.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:01.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:01.623429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 344/667] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:01.624193 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f8ac-bd7c-4961-85ca-0e5bbbefc65e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-7945a29e-284e-47c6-b627-eb7a6850255d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:01.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:01.641248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:01.642327 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:01.642327 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:01.642327 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:01.642327 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:01.643890 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 324/668] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:01.644820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945a29e-284e-47c6-b627-eb7a6850255d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.735140 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f8ac-bd7c-4961-85ca-0e5bbbefc65e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.738349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.754289 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945a29e-284e-47c6-b627-eb7a6850255d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.771509 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726a2b7-2520-4d1d-805b-86b1684003bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.772177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726a2b7-2520-4d1d-805b-86b1684003bf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.772524 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726a2b7-2520-4d1d-805b-86b1684003bf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.772803 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726a2b7-2520-4d1d-805b-86b1684003bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.781549 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.790717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094d3ff-ccae-4408-91ff-eed7183400cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.791380 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094d3ff-ccae-4408-91ff-eed7183400cc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.791659 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094d3ff-ccae-4408-91ff-eed7183400cc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.792130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094d3ff-ccae-4408-91ff-eed7183400cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.792763 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094d3ff-ccae-4408-91ff-eed7183400cc None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=808b08d1d2df42e587279071a5dba593) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:01.793073 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094d3ff-ccae-4408-91ff-eed7183400cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.794613 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094d3ff-ccae-4408-91ff-eed7183400cc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.801009 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 325/669] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/role_assignments?user.id=808b08d1d2df42e587279071a5dba593&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:01.801824 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094d3ff-ccae-4408-91ff-eed7183400cc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.864231 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726a2b7-2520-4d1d-805b-86b1684003bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.866458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726a2b7-2520-4d1d-805b-86b1684003bf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.936375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094d3ff-ccae-4408-91ff-eed7183400cc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.977730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5013b-1f86-4d1d-8e73-de0fe2737cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.978220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5013b-1f86-4d1d-8e73-de0fe2737cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.978500 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5013b-1f86-4d1d-8e73-de0fe2737cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.978774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5013b-1f86-4d1d-8e73-de0fe2737cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.979533 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5013b-1f86-4d1d-8e73-de0fe2737cc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:01.979836 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5013b-1f86-4d1d-8e73-de0fe2737cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.981237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5013b-1f86-4d1d-8e73-de0fe2737cc5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.999179 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 326/670] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:01.999816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5013b-1f86-4d1d-8e73-de0fe2737cc5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.001118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 345/671] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:02.006428 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726a2b7-2520-4d1d-805b-86b1684003bf None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.026267 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.049518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.120815 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5013b-1f86-4d1d-8e73-de0fe2737cc5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.128867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726a2b7-2520-4d1d-805b-86b1684003bf None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.157421 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0361b5-6465-485b-80d8-4d4b253821a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.158192 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0361b5-6465-485b-80d8-4d4b253821a3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.158478 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0361b5-6465-485b-80d8-4d4b253821a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.158873 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0361b5-6465-485b-80d8-4d4b253821a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.159610 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0361b5-6465-485b-80d8-4d4b253821a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:02.159915 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0361b5-6465-485b-80d8-4d4b253821a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.161312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0361b5-6465-485b-80d8-4d4b253821a3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.164297 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181b52d-8319-44bb-a60e-fec3e971856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.165103 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181b52d-8319-44bb-a60e-fec3e971856a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.165419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181b52d-8319-44bb-a60e-fec3e971856a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.165688 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181b52d-8319-44bb-a60e-fec3e971856a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.177842 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 327/672] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:02.177842 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0361b5-6465-485b-80d8-4d4b253821a3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.178137 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181b52d-8319-44bb-a60e-fec3e971856a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.178778 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181b52d-8319-44bb-a60e-fec3e971856a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-9181b52d-8319-44bb-a60e-fec3e971856a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:02.198118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:02.199144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:02.200199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:02.200199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:02.200199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:02.200199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:02.200199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 346/673] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:02.200800 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194e13f-5734-41d6-bc47-4db8ff29df73 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.200896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194e13f-5734-41d6-bc47-4db8ff29df73 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.201116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194e13f-5734-41d6-bc47-4db8ff29df73 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.202615 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 347/674] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:02.203154 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194e13f-5734-41d6-bc47-4db8ff29df73 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.263129 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.293289 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0361b5-6465-485b-80d8-4d4b253821a3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.302084 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.314340 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194e13f-5734-41d6-bc47-4db8ff29df73 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.328384 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9d690-e8ae-4601-bc14-62f879258f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.329186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9d690-e8ae-4601-bc14-62f879258f2b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.329491 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9d690-e8ae-4601-bc14-62f879258f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.329759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9d690-e8ae-4601-bc14-62f879258f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.340748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9d690-e8ae-4601-bc14-62f879258f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.342230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9d690-e8ae-4601-bc14-62f879258f2b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.352597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9d4bc-1325-4f7d-a78a-cff2e699670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.353432 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9d4bc-1325-4f7d-a78a-cff2e699670d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.353709 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9d4bc-1325-4f7d-a78a-cff2e699670d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.353976 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9d4bc-1325-4f7d-a78a-cff2e699670d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-09c9d690-e8ae-4601-bc14-62f879258f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:02.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:02.361107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:02.362051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:02.362051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:02.362051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:02.362051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:02.363229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9d4bc-1325-4f7d-a78a-cff2e699670d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.364698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9d4bc-1325-4f7d-a78a-cff2e699670d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.366175 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 328/675] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:02.366877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9d690-e8ae-4601-bc14-62f879258f2b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-03c9d4bc-1325-4f7d-a78a-cff2e699670d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:02.379320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:02.380241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:02.381171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:02.381171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:02.381171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:02.381171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:02.381171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:02.381171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:02.381171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:02.381171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:02.381171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 348/676] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:02.381738 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf755516-600f-4790-ad8a-7ac38dc475ee None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.382446 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf755516-600f-4790-ad8a-7ac38dc475ee None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.382446 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf755516-600f-4790-ad8a-7ac38dc475ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.402882 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-cf755516-600f-4790-ad8a-7ac38dc475ee None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:02.404095 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-cf755516-600f-4790-ad8a-7ac38dc475ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:02.474497 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9d690-e8ae-4601-bc14-62f879258f2b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.476815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 349/677] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:02.482081 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf755516-600f-4790-ad8a-7ac38dc475ee None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.501083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.517876 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eab16-24d5-4e8a-a363-3e23738a30ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.519357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eab16-24d5-4e8a-a363-3e23738a30ed None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.519812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eab16-24d5-4e8a-a363-3e23738a30ed None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.520247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eab16-24d5-4e8a-a363-3e23738a30ed None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.521164 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364eab16-24d5-4e8a-a363-3e23738a30ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:02.521789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364eab16-24d5-4e8a-a363-3e23738a30ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.523177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364eab16-24d5-4e8a-a363-3e23738a30ed None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.540000 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 329/678] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:02.540000 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eab16-24d5-4e8a-a363-3e23738a30ed None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.577361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.602356 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf755516-600f-4790-ad8a-7ac38dc475ee None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.638380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02f483-0d67-41c1-8c1a-0fe7ad97fa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.639059 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02f483-0d67-41c1-8c1a-0fe7ad97fa9c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.639408 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02f483-0d67-41c1-8c1a-0fe7ad97fa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.639689 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02f483-0d67-41c1-8c1a-0fe7ad97fa9c None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.640418 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02f483-0d67-41c1-8c1a-0fe7ad97fa9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:02.640723 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02f483-0d67-41c1-8c1a-0fe7ad97fa9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.642133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02f483-0d67-41c1-8c1a-0fe7ad97fa9c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.651024 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eab16-24d5-4e8a-a363-3e23738a30ed None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.653479 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 350/679] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:02.654277 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02f483-0d67-41c1-8c1a-0fe7ad97fa9c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.694680 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd80ac-704a-4968-b8b1-0010dd4fbf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.696156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd80ac-704a-4968-b8b1-0010dd4fbf8a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.696624 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd80ac-704a-4968-b8b1-0010dd4fbf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.697115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd80ac-704a-4968-b8b1-0010dd4fbf8a None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.698387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd80ac-704a-4968-b8b1-0010dd4fbf8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:02.698895 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd80ac-704a-4968-b8b1-0010dd4fbf8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.700342 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd80ac-704a-4968-b8b1-0010dd4fbf8a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.718286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 330/680] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:02.719377 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd80ac-704a-4968-b8b1-0010dd4fbf8a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.758389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02f483-0d67-41c1-8c1a-0fe7ad97fa9c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.765236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.794011 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7de69c-0ad7-413c-93b3-1c1de9f7cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.794782 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7de69c-0ad7-413c-93b3-1c1de9f7cec2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.795070 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7de69c-0ad7-413c-93b3-1c1de9f7cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.795350 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7de69c-0ad7-413c-93b3-1c1de9f7cec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.804991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.807779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7de69c-0ad7-413c-93b3-1c1de9f7cec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.809442 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7de69c-0ad7-413c-93b3-1c1de9f7cec2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.823908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd80ac-704a-4968-b8b1-0010dd4fbf8a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-0d7de69c-0ad7-413c-93b3-1c1de9f7cec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:02.827536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:02.828430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:02.829375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:02.829375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:02.829375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:02.829375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:02.829375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 351/681] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:02.830232 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7de69c-0ad7-413c-93b3-1c1de9f7cec2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.865680 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4a996-4e81-43be-890c-0c151e4edf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.866891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a996-4e81-43be-890c-0c151e4edf4a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.867383 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a996-4e81-43be-890c-0c151e4edf4a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a996-4e81-43be-890c-0c151e4edf4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.876657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4a996-4e81-43be-890c-0c151e4edf4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.878419 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4a996-4e81-43be-890c-0c151e4edf4a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-eab4a996-4e81-43be-890c-0c151e4edf4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:02.900107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:02.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:02.902069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:02.902069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:02.902069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:02.902069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:02.902069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:02.902069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:02.902069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:02.902069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:02.902069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 331/682] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:02.904741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4a996-4e81-43be-890c-0c151e4edf4a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.935950 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7de69c-0ad7-413c-93b3-1c1de9f7cec2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccbf99-87e1-4e10-ae7c-91615beb3890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.972988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccbf99-87e1-4e10-ae7c-91615beb3890 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.973179 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccbf99-87e1-4e10-ae7c-91615beb3890 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.973496 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccbf99-87e1-4e10-ae7c-91615beb3890 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.980961 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccbf99-87e1-4e10-ae7c-91615beb3890 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.982430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccbf99-87e1-4e10-ae7c-91615beb3890 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-54ccbf99-87e1-4e10-ae7c-91615beb3890 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:02.996665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:02.997701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:02.998658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:02.998658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:02.998658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:02.998658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:02.998658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:02.998658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:02.998658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:02.998658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:02.998658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:02.998658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:02.998658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 352/683] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:02.999287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccbf99-87e1-4e10-ae7c-91615beb3890 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.020731 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4a996-4e81-43be-890c-0c151e4edf4a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.023873 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.058408 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.063465 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4680-d240-4f36-9a3f-49212ca398e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.064160 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4680-d240-4f36-9a3f-49212ca398e0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.064443 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4680-d240-4f36-9a3f-49212ca398e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.064715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4680-d240-4f36-9a3f-49212ca398e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.065593 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4680-d240-4f36-9a3f-49212ca398e0 None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=e0dae91953bf4a84883723bf3639e377) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:03.065915 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4680-d240-4f36-9a3f-49212ca398e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.067361 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4680-d240-4f36-9a3f-49212ca398e0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.073412 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 332/684] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/role_assignments?user.id=e0dae91953bf4a84883723bf3639e377&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:03.074216 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4680-d240-4f36-9a3f-49212ca398e0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.125151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccbf99-87e1-4e10-ae7c-91615beb3890 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.164708 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95321dd4-aea7-4c56-8d12-195e315d4674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.165687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95321dd4-aea7-4c56-8d12-195e315d4674 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.166149 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95321dd4-aea7-4c56-8d12-195e315d4674 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.166425 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95321dd4-aea7-4c56-8d12-195e315d4674 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.167166 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95321dd4-aea7-4c56-8d12-195e315d4674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:03.167500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95321dd4-aea7-4c56-8d12-195e315d4674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.168977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95321dd4-aea7-4c56-8d12-195e315d4674 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.183685 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 353/685] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:03.184565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95321dd4-aea7-4c56-8d12-195e315d4674 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.218499 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4680-d240-4f36-9a3f-49212ca398e0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.257934 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b32b23-d959-4c3a-9537-1f56080cb678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.258615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b32b23-d959-4c3a-9537-1f56080cb678 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.258894 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b32b23-d959-4c3a-9537-1f56080cb678 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.259166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b32b23-d959-4c3a-9537-1f56080cb678 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.260153 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b32b23-d959-4c3a-9537-1f56080cb678 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:03.260283 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b32b23-d959-4c3a-9537-1f56080cb678 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.261775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b32b23-d959-4c3a-9537-1f56080cb678 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.274490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 333/686] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:03.275437 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b32b23-d959-4c3a-9537-1f56080cb678 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.296108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95321dd4-aea7-4c56-8d12-195e315d4674 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.307095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.310401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.340459 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e1a9e-8f38-48c5-9cca-1617c0901b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.341150 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e1a9e-8f38-48c5-9cca-1617c0901b32 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.341692 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e1a9e-8f38-48c5-9cca-1617c0901b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.341812 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e1a9e-8f38-48c5-9cca-1617c0901b32 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.343061 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e1a9e-8f38-48c5-9cca-1617c0901b32 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:03.343061 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e1a9e-8f38-48c5-9cca-1617c0901b32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.344429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e1a9e-8f38-48c5-9cca-1617c0901b32 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.363822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 354/687] 10.222.0.43 () {56 vars in 1135 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:03.364683 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e1a9e-8f38-48c5-9cca-1617c0901b32 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.390682 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b32b23-d959-4c3a-9537-1f56080cb678 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.433574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc29536-b9dc-44b5-ba98-391e1dbd2e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.434260 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc29536-b9dc-44b5-ba98-391e1dbd2e05 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.434544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc29536-b9dc-44b5-ba98-391e1dbd2e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.434819 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc29536-b9dc-44b5-ba98-391e1dbd2e05 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.435531 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc29536-b9dc-44b5-ba98-391e1dbd2e05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.437082 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc29536-b9dc-44b5-ba98-391e1dbd2e05 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.461578 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 334/688] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:53:03 2022] POST /identity/v3/users => generated 254 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:03.462552 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc29536-b9dc-44b5-ba98-391e1dbd2e05 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.508682 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e1a9e-8f38-48c5-9cca-1617c0901b32 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.551297 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77077b-4747-4a50-8448-b24c86132d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.551988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77077b-4747-4a50-8448-b24c86132d4c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.552275 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77077b-4747-4a50-8448-b24c86132d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.552550 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77077b-4747-4a50-8448-b24c86132d4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.553452 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77077b-4747-4a50-8448-b24c86132d4c None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=6c87c6bb14d74884a8c4ff8915d2494e) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:03.553768 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77077b-4747-4a50-8448-b24c86132d4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.556069 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77077b-4747-4a50-8448-b24c86132d4c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.563732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 355/689] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/role_assignments?user.id=6c87c6bb14d74884a8c4ff8915d2494e&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:03.645623 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.653502 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc29536-b9dc-44b5-ba98-391e1dbd2e05 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.694132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec127c-ee94-4912-9ec4-54d6292ce60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.694823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec127c-ee94-4912-9ec4-54d6292ce60e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.695108 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec127c-ee94-4912-9ec4-54d6292ce60e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.695440 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec127c-ee94-4912-9ec4-54d6292ce60e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.779114 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec127c-ee94-4912-9ec4-54d6292ce60e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.780680 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec127c-ee94-4912-9ec4-54d6292ce60e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.868256 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.885493 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 335/690] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:03.891263 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77077b-4747-4a50-8448-b24c86132d4c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.928412 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.999825 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77077b-4747-4a50-8448-b24c86132d4c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.035690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a161-ab09-4a72-a2b3-d7b66493fbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.036502 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a161-ab09-4a72-a2b3-d7b66493fbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.036828 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a161-ab09-4a72-a2b3-d7b66493fbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.037119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a161-ab09-4a72-a2b3-d7b66493fbb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.048706 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3a161-ab09-4a72-a2b3-d7b66493fbb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.050203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3a161-ab09-4a72-a2b3-d7b66493fbb5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.056495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b4e77-94b2-4c3f-9e37-914796a8eab8 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.056787 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b4e77-94b2-4c3f-9e37-914796a8eab8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.057066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b4e77-94b2-4c3f-9e37-914796a8eab8 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.058750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 336/691] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:04.065090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b1158-2977-4de1-a00f-8a2bcb69b9ab None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.065421 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b1158-2977-4de1-a00f-8a2bcb69b9ab None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.065754 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b1158-2977-4de1-a00f-8a2bcb69b9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-1ab3a161-ab09-4a72-a2b3-d7b66493fbb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:04.068258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:04.069127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:04.070097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:04.070097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:04.070097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:04.070097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:04.070097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 356/692] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:04.075134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a161-ab09-4a72-a2b3-d7b66493fbb5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.090854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6d7b1158-2977-4de1-a00f-8a2bcb69b9ab None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:04.092842 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6d7b1158-2977-4de1-a00f-8a2bcb69b9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:04.164945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:04.180918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a161-ab09-4a72-a2b3-d7b66493fbb5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.215869 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aba1e0-72a1-4268-9937-0dce7affcad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.216555 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aba1e0-72a1-4268-9937-0dce7affcad0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.216845 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aba1e0-72a1-4268-9937-0dce7affcad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.217126 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aba1e0-72a1-4268-9937-0dce7affcad0 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.218029 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aba1e0-72a1-4268-9937-0dce7affcad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:04.218339 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aba1e0-72a1-4268-9937-0dce7affcad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.219747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aba1e0-72a1-4268-9937-0dce7affcad0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.232759 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 357/693] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:04.238208 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aba1e0-72a1-4268-9937-0dce7affcad0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.262899 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 337/694] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:04.302968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b1158-2977-4de1-a00f-8a2bcb69b9ab None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.344261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aba1e0-72a1-4268-9937-0dce7affcad0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.380474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db36a6a-2f0c-4658-907e-87ce70f758f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.381350 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db36a6a-2f0c-4658-907e-87ce70f758f3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.381638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db36a6a-2f0c-4658-907e-87ce70f758f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.381912 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db36a6a-2f0c-4658-907e-87ce70f758f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.390470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db36a6a-2f0c-4658-907e-87ce70f758f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.392170 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db36a6a-2f0c-4658-907e-87ce70f758f3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-8db36a6a-2f0c-4658-907e-87ce70f758f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:04.410829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:04.411837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:04.412741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:04.412741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:04.412741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:04.412741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:04.412741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:04.412741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:04.412741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:04.412741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:04.412741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 358/695] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:04.418042 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db36a6a-2f0c-4658-907e-87ce70f758f3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.441596 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:04.482269 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b1158-2977-4de1-a00f-8a2bcb69b9ab None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:04.526947 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db36a6a-2f0c-4658-907e-87ce70f758f3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.546915 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c489c-618c-4ea8-bd73-df185266bf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.547960 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c489c-618c-4ea8-bd73-df185266bf30 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.548506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c489c-618c-4ea8-bd73-df185266bf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.548917 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c489c-618c-4ea8-bd73-df185266bf30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.563032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c783f-bfcb-4ec4-b993-5279f2c3e54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.568409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c783f-bfcb-4ec4-b993-5279f2c3e54b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.568409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c783f-bfcb-4ec4-b993-5279f2c3e54b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.568409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c783f-bfcb-4ec4-b993-5279f2c3e54b None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.568409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c783f-bfcb-4ec4-b993-5279f2c3e54b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:04.568409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c783f-bfcb-4ec4-b993-5279f2c3e54b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.568409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c783f-bfcb-4ec4-b993-5279f2c3e54b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.575818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c489c-618c-4ea8-bd73-df185266bf30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:04.581111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 359/696] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-768c489c-618c-4ea8-bd73-df185266bf30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:04.584358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:04.586588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:04.586588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:04.586588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:04.586588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:04.586588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:04.586588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:04.586588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:04.586588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:04.586588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:04.586588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:04.586588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:04.586588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:04.595286 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c783f-bfcb-4ec4-b993-5279f2c3e54b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.595918 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 338/697] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:04.598092 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c489c-618c-4ea8-bd73-df185266bf30 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.717806 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:04.779976 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c783f-bfcb-4ec4-b993-5279f2c3e54b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.784968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c489c-618c-4ea8-bd73-df185266bf30 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.840638 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dea141-2f8b-4a76-be8e-2bec1d1e6243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.841744 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dea141-2f8b-4a76-be8e-2bec1d1e6243 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.842314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dea141-2f8b-4a76-be8e-2bec1d1e6243 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.842812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dea141-2f8b-4a76-be8e-2bec1d1e6243 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.843780 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dea141-2f8b-4a76-be8e-2bec1d1e6243 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:04.844312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dea141-2f8b-4a76-be8e-2bec1d1e6243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.846026 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dea141-2f8b-4a76-be8e-2bec1d1e6243 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.853777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8549280-129c-4c58-afca-ace2c3932213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.854751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8549280-129c-4c58-afca-ace2c3932213 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.855246 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8549280-129c-4c58-afca-ace2c3932213 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.856695 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8549280-129c-4c58-afca-ace2c3932213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.857781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8549280-129c-4c58-afca-ace2c3932213 None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=bd9e9ad3ecec40b9a3c88a5f2b8fdfe2) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:04.858494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8549280-129c-4c58-afca-ace2c3932213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.862109 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8549280-129c-4c58-afca-ace2c3932213 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.862557 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 339/698] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:04.869981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dea141-2f8b-4a76-be8e-2bec1d1e6243 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.883088 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 360/699] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/role_assignments?user.id=bd9e9ad3ecec40b9a3c88a5f2b8fdfe2&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:04.934547 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:05.034737 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dea141-2f8b-4a76-be8e-2bec1d1e6243 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.074437 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d18542-be75-4a8e-b7ff-191f86a56068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.075603 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d18542-be75-4a8e-b7ff-191f86a56068 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.076109 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d18542-be75-4a8e-b7ff-191f86a56068 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.076628 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d18542-be75-4a8e-b7ff-191f86a56068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.087714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d18542-be75-4a8e-b7ff-191f86a56068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:05.089541 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d18542-be75-4a8e-b7ff-191f86a56068 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-46d18542-be75-4a8e-b7ff-191f86a56068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:05.107647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:05.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:05.109576 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:05.109576 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:05.109576 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:05.109576 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:05.111911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 340/700] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:05.117722 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8549280-129c-4c58-afca-ace2c3932213 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.233045 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8549280-129c-4c58-afca-ace2c3932213 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.267940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:05.275137 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffaaf8-6685-4048-a2bb-e0452288c83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.276093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffaaf8-6685-4048-a2bb-e0452288c83a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.276597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffaaf8-6685-4048-a2bb-e0452288c83a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.277070 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffaaf8-6685-4048-a2bb-e0452288c83a None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.278075 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffaaf8-6685-4048-a2bb-e0452288c83a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:05.278776 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffaaf8-6685-4048-a2bb-e0452288c83a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:05.280737 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffaaf8-6685-4048-a2bb-e0452288c83a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:05.293972 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 361/701] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:05.299897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d18542-be75-4a8e-b7ff-191f86a56068 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.334557 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee115-0f52-447b-8c3f-ab1c3db07e6b None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.334874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee115-0f52-447b-8c3f-ab1c3db07e6b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.335478 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee115-0f52-447b-8c3f-ab1c3db07e6b None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.337008 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 362/702] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:05.342085 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76536aa-cad9-4d9c-aa29-d382146d6d9c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.342394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76536aa-cad9-4d9c-aa29-d382146d6d9c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.342664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76536aa-cad9-4d9c-aa29-d382146d6d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.360756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c76536aa-cad9-4d9c-aa29-d382146d6d9c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:05.362333 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c76536aa-cad9-4d9c-aa29-d382146d6d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:05.407184 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:05.423517 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d18542-be75-4a8e-b7ff-191f86a56068 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.452919 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 363/703] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:53:05.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed0dfa-e2c0-4cae-ba0f-04e4a67b32cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.468133 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed0dfa-e2c0-4cae-ba0f-04e4a67b32cb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.468593 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed0dfa-e2c0-4cae-ba0f-04e4a67b32cb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.469043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed0dfa-e2c0-4cae-ba0f-04e4a67b32cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.476984 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed0dfa-e2c0-4cae-ba0f-04e4a67b32cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:05.477278 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76536aa-cad9-4d9c-aa29-d382146d6d9c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.478480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed0dfa-e2c0-4cae-ba0f-04e4a67b32cb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-60ed0dfa-e2c0-4cae-ba0f-04e4a67b32cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:05.499801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:05.500807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:05.502887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:05.502887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:05.502887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:05.502887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:05.502887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:05.502887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:05.502887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:05.502887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:05.502887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:05.502887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:05.505695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 341/704] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:05.511305 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed0dfa-e2c0-4cae-ba0f-04e4a67b32cb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.602780 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76536aa-cad9-4d9c-aa29-d382146d6d9c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.624931 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:05.641838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347501ad-cca7-44b7-8e57-0bb8a00ce7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.642686 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347501ad-cca7-44b7-8e57-0bb8a00ce7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.643033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347501ad-cca7-44b7-8e57-0bb8a00ce7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.643247 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347501ad-cca7-44b7-8e57-0bb8a00ce7c0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.643909 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347501ad-cca7-44b7-8e57-0bb8a00ce7c0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:05.645332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347501ad-cca7-44b7-8e57-0bb8a00ce7c0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:05.648967 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed0dfa-e2c0-4cae-ba0f-04e4a67b32cb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-347501ad-cca7-44b7-8e57-0bb8a00ce7c0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:05.659756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:05.660821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:05.661747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:05.665407 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 364/705] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:05.667146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347501ad-cca7-44b7-8e57-0bb8a00ce7c0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.694873 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ab82-a58d-4412-a729-b54c7b708ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.696181 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ab82-a58d-4412-a729-b54c7b708ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.696805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ab82-a58d-4412-a729-b54c7b708ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.697679 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ab82-a58d-4412-a729-b54c7b708ff0 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.699010 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321ab82-a58d-4412-a729-b54c7b708ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:05.699517 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321ab82-a58d-4412-a729-b54c7b708ff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:05.701858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321ab82-a58d-4412-a729-b54c7b708ff0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:05.724171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 342/706] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:05.730268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ab82-a58d-4412-a729-b54c7b708ff0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.744166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:05.816345 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347501ad-cca7-44b7-8e57-0bb8a00ce7c0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.878793 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1d4c1-c8b4-4773-8266-986d895e3105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.879392 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1d4c1-c8b4-4773-8266-986d895e3105 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.879677 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1d4c1-c8b4-4773-8266-986d895e3105 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.879952 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1d4c1-c8b4-4773-8266-986d895e3105 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.880671 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1d4c1-c8b4-4773-8266-986d895e3105 None admin] RBAC: Adding query filter params (name=network) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:05.880979 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1d4c1-c8b4-4773-8266-986d895e3105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:05.882411 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1d4c1-c8b4-4773-8266-986d895e3105 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:05.894898 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 365/707] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:05.900309 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1d4c1-c8b4-4773-8266-986d895e3105 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.910909 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ab82-a58d-4412-a729-b54c7b708ff0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.983124 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40216d4-c892-40ad-8f52-48637bf3a80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.983335 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:05.983725 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40216d4-c892-40ad-8f52-48637bf3a80a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.983725 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40216d4-c892-40ad-8f52-48637bf3a80a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.983725 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40216d4-c892-40ad-8f52-48637bf3a80a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.040101 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1d4c1-c8b4-4773-8266-986d895e3105 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.063463 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40216d4-c892-40ad-8f52-48637bf3a80a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.065077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40216d4-c892-40ad-8f52-48637bf3a80a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.073490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:06.075984 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90d41a-8f09-49ab-8cd8-383273419f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.076883 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90d41a-8f09-49ab-8cd8-383273419f02 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.077392 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90d41a-8f09-49ab-8cd8-383273419f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.077842 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90d41a-8f09-49ab-8cd8-383273419f02 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.078769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90d41a-8f09-49ab-8cd8-383273419f02 None admin] RBAC: Adding query filter params (type=network) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:06.079182 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90d41a-8f09-49ab-8cd8-383273419f02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.080679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90d41a-8f09-49ab-8cd8-383273419f02 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.093404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 366/708] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:06.095144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c62682-735e-4cef-ade3-f033fd269739 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.095571 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c62682-735e-4cef-ade3-f033fd269739 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.095950 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c62682-735e-4cef-ade3-f033fd269739 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.097736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 367/709] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:06.103463 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db4b9a-5612-4aca-88a3-b17fac8654ea None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.103853 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db4b9a-5612-4aca-88a3-b17fac8654ea None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.104230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db4b9a-5612-4aca-88a3-b17fac8654ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.138576 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-16db4b9a-5612-4aca-88a3-b17fac8654ea None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:06.139802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-16db4b9a-5612-4aca-88a3-b17fac8654ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:06.175832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 343/710] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:06.186342 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40216d4-c892-40ad-8f52-48637bf3a80a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.283630 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 368/711] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:53:06.295382 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40216d4-c892-40ad-8f52-48637bf3a80a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.304113 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:06.327177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db4b9a-5612-4aca-88a3-b17fac8654ea None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.335457 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd24d82-c925-45d7-a77f-03b3f585432d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.336200 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd24d82-c925-45d7-a77f-03b3f585432d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.336482 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd24d82-c925-45d7-a77f-03b3f585432d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.336757 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd24d82-c925-45d7-a77f-03b3f585432d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.347824 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd24d82-c925-45d7-a77f-03b3f585432d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.349343 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd24d82-c925-45d7-a77f-03b3f585432d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-5bd24d82-c925-45d7-a77f-03b3f585432d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:06.367439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:06.368458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:06.369649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:06.369649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:06.369649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:06.369649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:06.369649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 344/712] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:06.378802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:06.379706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd24d82-c925-45d7-a77f-03b3f585432d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.441915 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db4b9a-5612-4aca-88a3-b17fac8654ea None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.481809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea9c03-2e7c-41e8-b53e-0517e91314d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.482676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9c03-2e7c-41e8-b53e-0517e91314d4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.482968 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9c03-2e7c-41e8-b53e-0517e91314d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.483247 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9c03-2e7c-41e8-b53e-0517e91314d4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.484010 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea9c03-2e7c-41e8-b53e-0517e91314d4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.485522 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea9c03-2e7c-41e8-b53e-0517e91314d4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.487844 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd24d82-c925-45d7-a77f-03b3f585432d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-5cea9c03-2e7c-41e8-b53e-0517e91314d4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:06.498648 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:06.500917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:06.503044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 369/713] 10.222.0.43 () {56 vars in 1129 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:06.507974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19321ebb-0e92-4904-af45-fd73732abe55 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.507974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19321ebb-0e92-4904-af45-fd73732abe55 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.507974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19321ebb-0e92-4904-af45-fd73732abe55 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.507974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 370/714] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:06.509464 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19321ebb-0e92-4904-af45-fd73732abe55 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.524621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125f191-32b6-413f-b235-a4949d9ce3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.525424 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125f191-32b6-413f-b235-a4949d9ce3ed None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.525710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125f191-32b6-413f-b235-a4949d9ce3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.526085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125f191-32b6-413f-b235-a4949d9ce3ed None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.526827 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125f191-32b6-413f-b235-a4949d9ce3ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:06.527134 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125f191-32b6-413f-b235-a4949d9ce3ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.528627 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125f191-32b6-413f-b235-a4949d9ce3ed None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.541764 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 345/715] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:06.543021 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed76e2c-91d6-4be9-8841-c8c857b16d36 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.548114 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed76e2c-91d6-4be9-8841-c8c857b16d36 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.548420 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed76e2c-91d6-4be9-8841-c8c857b16d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.567114 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5ed76e2c-91d6-4be9-8841-c8c857b16d36 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:06.568422 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5ed76e2c-91d6-4be9-8841-c8c857b16d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:06.590956 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:06.622513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19321ebb-0e92-4904-af45-fd73732abe55 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.630940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:06.669227 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 346/716] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:06.669227 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed76e2c-91d6-4be9-8841-c8c857b16d36 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.672003 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7986cdb-2785-4627-903f-51833cac8f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.672969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7986cdb-2785-4627-903f-51833cac8f04 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.673419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7986cdb-2785-4627-903f-51833cac8f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.673878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7986cdb-2785-4627-903f-51833cac8f04 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.674802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7986cdb-2785-4627-903f-51833cac8f04 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:06.675244 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7986cdb-2785-4627-903f-51833cac8f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.676882 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7986cdb-2785-4627-903f-51833cac8f04 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.689858 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 371/717] 10.222.0.43 () {56 vars in 1124 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:06.695726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7986cdb-2785-4627-903f-51833cac8f04 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.791849 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed76e2c-91d6-4be9-8841-c8c857b16d36 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.818833 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7986cdb-2785-4627-903f-51833cac8f04 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.835926 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4328e0e-94eb-4180-918f-c65f5c6644e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.836986 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4328e0e-94eb-4180-918f-c65f5c6644e1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.837292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4328e0e-94eb-4180-918f-c65f5c6644e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.837569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4328e0e-94eb-4180-918f-c65f5c6644e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.846484 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4328e0e-94eb-4180-918f-c65f5c6644e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.848358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4328e0e-94eb-4180-918f-c65f5c6644e1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.861535 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e40cf-b9b6-4e6e-9ef0-018f9a426917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.862469 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e40cf-b9b6-4e6e-9ef0-018f9a426917 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.862902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e40cf-b9b6-4e6e-9ef0-018f9a426917 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.863324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e40cf-b9b6-4e6e-9ef0-018f9a426917 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.864225 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e40cf-b9b6-4e6e-9ef0-018f9a426917 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:06.864673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e40cf-b9b6-4e6e-9ef0-018f9a426917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.866337 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e40cf-b9b6-4e6e-9ef0-018f9a426917 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b4328e0e-94eb-4180-918f-c65f5c6644e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:06.867364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:06.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:06.869395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:06.869395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:06.869395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:06.869395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:06.869395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:06.869395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:06.869395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:06.869395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:06.869395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 347/718] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:06.870294 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4328e0e-94eb-4180-918f-c65f5c6644e1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.881296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 372/719] 10.222.0.43 () {56 vars in 1124 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:06.882690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e40cf-b9b6-4e6e-9ef0-018f9a426917 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.883496 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:06.986063 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4328e0e-94eb-4180-918f-c65f5c6644e1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:07.011821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:07.037033 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dda19-768b-48ec-9894-f764bd63b46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:07.037908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dda19-768b-48ec-9894-f764bd63b46a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.038181 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dda19-768b-48ec-9894-f764bd63b46a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.038436 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dda19-768b-48ec-9894-f764bd63b46a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.065522 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dda19-768b-48ec-9894-f764bd63b46a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-737dda19-768b-48ec-9894-f764bd63b46a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:07.073402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:07.074403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:07.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:07.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:07.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:07.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:07.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:07.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:07.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:07.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:07.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:07.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:07.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:07.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:07.087918 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 348/720] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:07.088888 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dda19-768b-48ec-9894-f764bd63b46a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:07.135125 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e40cf-b9b6-4e6e-9ef0-018f9a426917 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:07.180917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb2917-a6c9-4bd6-98c4-82d0dc9539c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:07.180917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb2917-a6c9-4bd6-98c4-82d0dc9539c7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.180917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb2917-a6c9-4bd6-98c4-82d0dc9539c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.181758 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb2917-a6c9-4bd6-98c4-82d0dc9539c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.182012 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb2917-a6c9-4bd6-98c4-82d0dc9539c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:07.182189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb2917-a6c9-4bd6-98c4-82d0dc9539c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:07.183590 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb2917-a6c9-4bd6-98c4-82d0dc9539c7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:07.184373 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:07.198463 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 373/721] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:07.205241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb2917-a6c9-4bd6-98c4-82d0dc9539c7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:07.253831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dda19-768b-48ec-9894-f764bd63b46a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:07.320604 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571b210-9f57-41ec-89c3-670e53c1b82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:07.321303 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571b210-9f57-41ec-89c3-670e53c1b82a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.321584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571b210-9f57-41ec-89c3-670e53c1b82a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.321856 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571b210-9f57-41ec-89c3-670e53c1b82a None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.322609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571b210-9f57-41ec-89c3-670e53c1b82a None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:07.322913 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571b210-9f57-41ec-89c3-670e53c1b82a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:07.324287 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571b210-9f57-41ec-89c3-670e53c1b82a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:07.339885 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 349/722] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:53:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:07.343137 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571b210-9f57-41ec-89c3-670e53c1b82a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:07.383961 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:07.398002 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb2917-a6c9-4bd6-98c4-82d0dc9539c7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:07.434255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747fc8b-75b2-4cb3-b08f-b90fc5404c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:07.434929 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747fc8b-75b2-4cb3-b08f-b90fc5404c7e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.435217 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747fc8b-75b2-4cb3-b08f-b90fc5404c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.435494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747fc8b-75b2-4cb3-b08f-b90fc5404c7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.436400 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747fc8b-75b2-4cb3-b08f-b90fc5404c7e None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=808b08d1d2df42e587279071a5dba593) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:07.436716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747fc8b-75b2-4cb3-b08f-b90fc5404c7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:07.438256 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747fc8b-75b2-4cb3-b08f-b90fc5404c7e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:07.444466 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 374/723] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:07 2022] GET /identity/v3/role_assignments?user.id=808b08d1d2df42e587279071a5dba593&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:07.539673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571b210-9f57-41ec-89c3-670e53c1b82a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:07.581345 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:07.595644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e9933-cf8a-4df3-b49e-c1cee464d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:07.596481 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e9933-cf8a-4df3-b49e-c1cee464d28c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.596761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e9933-cf8a-4df3-b49e-c1cee464d28c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.597031 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e9933-cf8a-4df3-b49e-c1cee464d28c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.617993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e9933-cf8a-4df3-b49e-c1cee464d28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:07.619476 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e9933-cf8a-4df3-b49e-c1cee464d28c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9d8e9933-cf8a-4df3-b49e-c1cee464d28c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:07.644357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:07.645315 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:07.646272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:07.646272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:07.646272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:07.646272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:07.646272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 350/724] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:07.653069 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747fc8b-75b2-4cb3-b08f-b90fc5404c7e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:07.765795 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747fc8b-75b2-4cb3-b08f-b90fc5404c7e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:07.799978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53561d-d2a4-4813-9957-c36113775d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:07.800573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53561d-d2a4-4813-9957-c36113775d0c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.800934 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53561d-d2a4-4813-9957-c36113775d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.801229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53561d-d2a4-4813-9957-c36113775d0c None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.802022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53561d-d2a4-4813-9957-c36113775d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:07.802326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53561d-d2a4-4813-9957-c36113775d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:07.803788 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53561d-d2a4-4813-9957-c36113775d0c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:07.816568 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 375/725] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:07.822144 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e9933-cf8a-4df3-b49e-c1cee464d28c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:07.833317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeeb96-48c6-4a19-9150-338744b18368 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.833650 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeeb96-48c6-4a19-9150-338744b18368 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.833934 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeeb96-48c6-4a19-9150-338744b18368 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.835941 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 376/726] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:07.844332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126352fc-15f8-47f7-86fd-8415f34bb75a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.844654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126352fc-15f8-47f7-86fd-8415f34bb75a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.846523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126352fc-15f8-47f7-86fd-8415f34bb75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.877193 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-126352fc-15f8-47f7-86fd-8415f34bb75a None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:07.879479 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-126352fc-15f8-47f7-86fd-8415f34bb75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:07.909099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:07.990535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e9933-cf8a-4df3-b49e-c1cee464d28c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.002041 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 377/727] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:08.028876 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063efe65-a019-4957-b489-35d05ebe1e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.030169 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063efe65-a019-4957-b489-35d05ebe1e3a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.030678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063efe65-a019-4957-b489-35d05ebe1e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.031170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063efe65-a019-4957-b489-35d05ebe1e3a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.039322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063efe65-a019-4957-b489-35d05ebe1e3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.041041 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063efe65-a019-4957-b489-35d05ebe1e3a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.056686 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126352fc-15f8-47f7-86fd-8415f34bb75a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-063efe65-a019-4957-b489-35d05ebe1e3a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:08.068047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:08.069027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:08.070036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:08.070036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:08.070036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:08.070036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:08.070036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:08.070036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:08.070036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:08.070036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:08.070036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:08.070036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:08.074492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 351/728] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Jul 24 00:53:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:08.078414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063efe65-a019-4957-b489-35d05ebe1e3a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.129527 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:08.194948 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063efe65-a019-4957-b489-35d05ebe1e3a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.234880 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050899c0-ebe4-4d9e-84b9-9aba24e81f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.235986 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050899c0-ebe4-4d9e-84b9-9aba24e81f77 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.236471 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050899c0-ebe4-4d9e-84b9-9aba24e81f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.236946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050899c0-ebe4-4d9e-84b9-9aba24e81f77 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.238334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050899c0-ebe4-4d9e-84b9-9aba24e81f77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:08.238864 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050899c0-ebe4-4d9e-84b9-9aba24e81f77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.240769 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050899c0-ebe4-4d9e-84b9-9aba24e81f77 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.261771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 352/729] 10.222.0.43 () {56 vars in 1149 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:08.267021 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050899c0-ebe4-4d9e-84b9-9aba24e81f77 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.358066 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126352fc-15f8-47f7-86fd-8415f34bb75a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.385734 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:08.400991 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050899c0-ebe4-4d9e-84b9-9aba24e81f77 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.416964 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f40c2-d666-4635-a8c1-e7246e6f8f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.417806 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f40c2-d666-4635-a8c1-e7246e6f8f6d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.418086 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f40c2-d666-4635-a8c1-e7246e6f8f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.418357 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f40c2-d666-4635-a8c1-e7246e6f8f6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.437555 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f40c2-d666-4635-a8c1-e7246e6f8f6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-999f40c2-d666-4635-a8c1-e7246e6f8f6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:08.454173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:08.455152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:08.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 378/730] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:08.461573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f40c2-d666-4635-a8c1-e7246e6f8f6d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.473368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96170c8-7f47-4536-813f-c6026a385642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.480741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:08.481990 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96170c8-7f47-4536-813f-c6026a385642 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.482266 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96170c8-7f47-4536-813f-c6026a385642 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.482632 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96170c8-7f47-4536-813f-c6026a385642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.595266 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f40c2-d666-4635-a8c1-e7246e6f8f6d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.638213 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4bcc1-1573-4ef3-a798-71455a2c0a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.639283 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4bcc1-1573-4ef3-a798-71455a2c0a44 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.639767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4bcc1-1573-4ef3-a798-71455a2c0a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.640253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4bcc1-1573-4ef3-a798-71455a2c0a44 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.641243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4bcc1-1573-4ef3-a798-71455a2c0a44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:08.641747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4bcc1-1573-4ef3-a798-71455a2c0a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.643332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4bcc1-1573-4ef3-a798-71455a2c0a44 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.657682 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 379/731] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:08.659389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d72cd-f42a-4a87-acf3-a752a72c7927 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.659905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d72cd-f42a-4a87-acf3-a752a72c7927 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.660400 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d72cd-f42a-4a87-acf3-a752a72c7927 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.661047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96170c8-7f47-4536-813f-c6026a385642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.662370 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 380/732] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:08.662841 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96170c8-7f47-4536-813f-c6026a385642 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.663516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d72cd-f42a-4a87-acf3-a752a72c7927 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.740807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:08.764167 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:08.768804 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 353/733] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:08.774147 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012900df-f51c-4443-a0cd-31ccfaf9de29 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.775010 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012900df-f51c-4443-a0cd-31ccfaf9de29 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.775497 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012900df-f51c-4443-a0cd-31ccfaf9de29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.778470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d72cd-f42a-4a87-acf3-a752a72c7927 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.796620 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-012900df-f51c-4443-a0cd-31ccfaf9de29 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:08.798704 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-012900df-f51c-4443-a0cd-31ccfaf9de29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:08.823598 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dff110-f2c9-4de9-95b4-8cc36efa8da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.824423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dff110-f2c9-4de9-95b4-8cc36efa8da3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.824706 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dff110-f2c9-4de9-95b4-8cc36efa8da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.825015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dff110-f2c9-4de9-95b4-8cc36efa8da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.841061 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dff110-f2c9-4de9-95b4-8cc36efa8da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.842988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dff110-f2c9-4de9-95b4-8cc36efa8da3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-93dff110-f2c9-4de9-95b4-8cc36efa8da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:08.865837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:08.866819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:08.867741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:08.867741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:08.867741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:08.867741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:08.867741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 381/734] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:08.868459 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dff110-f2c9-4de9-95b4-8cc36efa8da3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.893329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 354/735] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:08.893329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012900df-f51c-4443-a0cd-31ccfaf9de29 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.999139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dff110-f2c9-4de9-95b4-8cc36efa8da3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:09.006942 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012900df-f51c-4443-a0cd-31ccfaf9de29 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:09.024047 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:09.037422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e49b0a-8b2d-4b01-93d4-5b9f4c277491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.037902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:09.038554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e49b0a-8b2d-4b01-93d4-5b9f4c277491 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.038867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e49b0a-8b2d-4b01-93d4-5b9f4c277491 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.039186 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e49b0a-8b2d-4b01-93d4-5b9f4c277491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.046005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4533b-14c1-44f5-8b1d-6c5960d3f03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.046891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4533b-14c1-44f5-8b1d-6c5960d3f03d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.047321 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4533b-14c1-44f5-8b1d-6c5960d3f03d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.047741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4533b-14c1-44f5-8b1d-6c5960d3f03d None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.048614 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4533b-14c1-44f5-8b1d-6c5960d3f03d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:09.049080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4533b-14c1-44f5-8b1d-6c5960d3f03d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:09.050666 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4533b-14c1-44f5-8b1d-6c5960d3f03d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:09.052367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e49b0a-8b2d-4b01-93d4-5b9f4c277491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:09.053969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e49b0a-8b2d-4b01-93d4-5b9f4c277491 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:09.064256 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 355/736] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:09.065324 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4533b-14c1-44f5-8b1d-6c5960d3f03d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-82e49b0a-8b2d-4b01-93d4-5b9f4c277491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:09.072461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:09.073618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:09.074575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:09.074575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:09.074575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:09.074575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:09.079769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 382/737] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:09.080814 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e49b0a-8b2d-4b01-93d4-5b9f4c277491 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:09.172531 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4533b-14c1-44f5-8b1d-6c5960d3f03d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:09.185459 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e49b0a-8b2d-4b01-93d4-5b9f4c277491 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:09.209047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443aecc7-a3de-4034-b090-1db0d0fa09e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.210472 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aecc7-a3de-4034-b090-1db0d0fa09e9 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.211023 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aecc7-a3de-4034-b090-1db0d0fa09e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.211518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aecc7-a3de-4034-b090-1db0d0fa09e9 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.212456 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443aecc7-a3de-4034-b090-1db0d0fa09e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:09.214067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443aecc7-a3de-4034-b090-1db0d0fa09e9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:09.223472 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b090b-ebe2-4855-819a-8a212e97be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.224450 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b090b-ebe2-4855-819a-8a212e97be26 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.224774 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b090b-ebe2-4855-819a-8a212e97be26 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.225433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b090b-ebe2-4855-819a-8a212e97be26 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.234067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 356/738] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:09 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:09.235168 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443aecc7-a3de-4034-b090-1db0d0fa09e9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:09.243274 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b090b-ebe2-4855-819a-8a212e97be26 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:09.250312 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b090b-ebe2-4855-819a-8a212e97be26 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-708b090b-ebe2-4855-819a-8a212e97be26 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:09.278694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:09.279834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:09.280902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:09.280902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:09.280902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:09.280902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:09.280902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:09.280902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:09.280902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:09.280902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:09.280902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:09.280902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:09.287901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 383/739] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:09.293871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b090b-ebe2-4855-819a-8a212e97be26 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:09.333934 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:09.343927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:09.419520 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b090b-ebe2-4855-819a-8a212e97be26 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:09.424665 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443aecc7-a3de-4034-b090-1db0d0fa09e9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:09.463646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbfd5e-4b31-4fbc-a5b5-5ac4a2a4f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.464358 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbfd5e-4b31-4fbc-a5b5-5ac4a2a4f41a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.464637 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbfd5e-4b31-4fbc-a5b5-5ac4a2a4f41a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.464907 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbfd5e-4b31-4fbc-a5b5-5ac4a2a4f41a None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.465789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbfd5e-4b31-4fbc-a5b5-5ac4a2a4f41a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:09.466096 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbfd5e-4b31-4fbc-a5b5-5ac4a2a4f41a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:09.467654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbfd5e-4b31-4fbc-a5b5-5ac4a2a4f41a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:09.469347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad1b88-4be2-42bb-99a7-d771aa1ac829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.470032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad1b88-4be2-42bb-99a7-d771aa1ac829 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.470312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad1b88-4be2-42bb-99a7-d771aa1ac829 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.471215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad1b88-4be2-42bb-99a7-d771aa1ac829 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.471337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad1b88-4be2-42bb-99a7-d771aa1ac829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:09.471618 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad1b88-4be2-42bb-99a7-d771aa1ac829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:09.473005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad1b88-4be2-42bb-99a7-d771aa1ac829 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:09.486446 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 357/740] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:09.487745 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 384/741] 10.222.0.43 () {56 vars in 1135 bytes} [Sun Jul 24 00:53:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:09.487868 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ae083-305f-44a1-86ac-ba3f2b4ecd62 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.488067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ae083-305f-44a1-86ac-ba3f2b4ecd62 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.488344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ae083-305f-44a1-86ac-ba3f2b4ecd62 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.495395 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbfd5e-4b31-4fbc-a5b5-5ac4a2a4f41a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:09.495543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 358/742] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:09.495543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ae083-305f-44a1-86ac-ba3f2b4ecd62 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:09.593088 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:09.601773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbfd5e-4b31-4fbc-a5b5-5ac4a2a4f41a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:09.602618 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ae083-305f-44a1-86ac-ba3f2b4ecd62 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:09.610747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:09.639605 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b6c33-4852-4fd0-aada-cf8c7fd5997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.640256 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd62f77-8ff9-40eb-892c-b476d31c1ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.640809 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6c33-4852-4fd0-aada-cf8c7fd5997d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.641292 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd62f77-8ff9-40eb-892c-b476d31c1ebf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.641506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6c33-4852-4fd0-aada-cf8c7fd5997d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.641732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd62f77-8ff9-40eb-892c-b476d31c1ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.642078 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd62f77-8ff9-40eb-892c-b476d31c1ebf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.642307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6c33-4852-4fd0-aada-cf8c7fd5997d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.649654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd62f77-8ff9-40eb-892c-b476d31c1ebf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:09.651599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd62f77-8ff9-40eb-892c-b476d31c1ebf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-5fd62f77-8ff9-40eb-892c-b476d31c1ebf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:09.670560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:09.671498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:09.672374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:09.672374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:09.672374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:09.672374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:09.672374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:09.672374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:09.672374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:09.672374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:09.672374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 385/743] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:09.673999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8737d-41da-46ec-b567-4cb3ee69d6c6 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.674353 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8737d-41da-46ec-b567-4cb3ee69d6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.674866 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8737d-41da-46ec-b567-4cb3ee69d6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.692718 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6ef8737d-41da-46ec-b567-4cb3ee69d6c6 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:09.694160 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6ef8737d-41da-46ec-b567-4cb3ee69d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:09.717125 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b6c33-4852-4fd0-aada-cf8c7fd5997d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:09.718906 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b6c33-4852-4fd0-aada-cf8c7fd5997d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:09.773372 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 386/744] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:09 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:09.774496 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8737d-41da-46ec-b567-4cb3ee69d6c6 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:09.830375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 359/745] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:09 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:09.832318 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8338f36-2b2c-4395-8c15-0c2060fcbfbf None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.832679 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8338f36-2b2c-4395-8c15-0c2060fcbfbf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.833042 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8338f36-2b2c-4395-8c15-0c2060fcbfbf None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.835418 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 360/746] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:09.836571 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8338f36-2b2c-4395-8c15-0c2060fcbfbf None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:09.847434 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:09.864058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:09.886611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8737d-41da-46ec-b567-4cb3ee69d6c6 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:09.922282 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cba2b5-5d1f-41b2-ba9b-d385d3e3893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.922940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cba2b5-5d1f-41b2-ba9b-d385d3e3893f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.923219 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cba2b5-5d1f-41b2-ba9b-d385d3e3893f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.923489 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cba2b5-5d1f-41b2-ba9b-d385d3e3893f None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.924272 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cba2b5-5d1f-41b2-ba9b-d385d3e3893f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:09.924576 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cba2b5-5d1f-41b2-ba9b-d385d3e3893f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:09.926093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cba2b5-5d1f-41b2-ba9b-d385d3e3893f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:09.942657 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 387/747] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:09.943542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cba2b5-5d1f-41b2-ba9b-d385d3e3893f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:09.951867 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8338f36-2b2c-4395-8c15-0c2060fcbfbf None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:09.990518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226367ee-99b9-49a2-90e2-cc9cfeca5907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.991286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226367ee-99b9-49a2-90e2-cc9cfeca5907 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.991570 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226367ee-99b9-49a2-90e2-cc9cfeca5907 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.991845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226367ee-99b9-49a2-90e2-cc9cfeca5907 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.992585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226367ee-99b9-49a2-90e2-cc9cfeca5907 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:09.994023 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226367ee-99b9-49a2-90e2-cc9cfeca5907 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:10.009758 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 361/748] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:09 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:10.011788 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e462806-74f5-4eab-8305-bec12da6295a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.012332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e462806-74f5-4eab-8305-bec12da6295a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.012812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e462806-74f5-4eab-8305-bec12da6295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.031305 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0e462806-74f5-4eab-8305-bec12da6295a None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:10.032976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0e462806-74f5-4eab-8305-bec12da6295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:10.076678 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cba2b5-5d1f-41b2-ba9b-d385d3e3893f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:10.112603 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:10.130130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 362/749] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:10.131022 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e462806-74f5-4eab-8305-bec12da6295a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:10.140413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9775f-9038-4f9a-a093-2b8a896a67d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:10.141542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9775f-9038-4f9a-a093-2b8a896a67d2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.142024 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9775f-9038-4f9a-a093-2b8a896a67d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.142671 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9775f-9038-4f9a-a093-2b8a896a67d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.151373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:10.157420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9775f-9038-4f9a-a093-2b8a896a67d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:10.159337 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9775f-9038-4f9a-a093-2b8a896a67d2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-5dc9775f-9038-4f9a-a093-2b8a896a67d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:10.180180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:10.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:10.182051 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:10.182051 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:10.182051 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:10.182051 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:10.184595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 388/750] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:10.185962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9775f-9038-4f9a-a093-2b8a896a67d2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:10.254932 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e462806-74f5-4eab-8305-bec12da6295a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:10.291904 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea1a2-be0d-4c9f-92d2-b1f9c90ab0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:10.293020 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea1a2-be0d-4c9f-92d2-b1f9c90ab0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.293407 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea1a2-be0d-4c9f-92d2-b1f9c90ab0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.293739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea1a2-be0d-4c9f-92d2-b1f9c90ab0f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.294647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ea1a2-be0d-4c9f-92d2-b1f9c90ab0f4 None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=8a465bdbfe3248679adc15154a152d23) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:10.294647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ea1a2-be0d-4c9f-92d2-b1f9c90ab0f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:10.297483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ea1a2-be0d-4c9f-92d2-b1f9c90ab0f4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:10.305946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 363/751] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:10 2022] GET /identity/v3/role_assignments?user.id=8a465bdbfe3248679adc15154a152d23&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:10.306798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea1a2-be0d-4c9f-92d2-b1f9c90ab0f4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:10.312483 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9775f-9038-4f9a-a093-2b8a896a67d2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:10.353426 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396a507-1bbe-43c5-b904-d8c38a789823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:10.354460 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a507-1bbe-43c5-b904-d8c38a789823 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.354751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a507-1bbe-43c5-b904-d8c38a789823 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.355040 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a507-1bbe-43c5-b904-d8c38a789823 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.367977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396a507-1bbe-43c5-b904-d8c38a789823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-4396a507-1bbe-43c5-b904-d8c38a789823 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:10.377139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:10.378157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:10.379227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 389/752] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:10.387116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396a507-1bbe-43c5-b904-d8c38a789823 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:10.469677 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:10.486861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:10.510949 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396a507-1bbe-43c5-b904-d8c38a789823 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:10.560861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a292aa0-89a4-4d9a-8592-6cc4ffc1d628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:10.561582 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a292aa0-89a4-4d9a-8592-6cc4ffc1d628 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.561866 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a292aa0-89a4-4d9a-8592-6cc4ffc1d628 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.562139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a292aa0-89a4-4d9a-8592-6cc4ffc1d628 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.562904 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a292aa0-89a4-4d9a-8592-6cc4ffc1d628 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:10.563213 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a292aa0-89a4-4d9a-8592-6cc4ffc1d628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:10.564596 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a292aa0-89a4-4d9a-8592-6cc4ffc1d628 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:10.586038 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea1a2-be0d-4c9f-92d2-b1f9c90ab0f4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:10.587212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 390/753] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:10.593513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a292aa0-89a4-4d9a-8592-6cc4ffc1d628 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:10.630724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1722-d340-423e-a7aa-6b47d0c4a1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:10.631408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1722-d340-423e-a7aa-6b47d0c4a1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.631693 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1722-d340-423e-a7aa-6b47d0c4a1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.631971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1722-d340-423e-a7aa-6b47d0c4a1c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.632717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a1722-d340-423e-a7aa-6b47d0c4a1c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:10.637247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a1722-d340-423e-a7aa-6b47d0c4a1c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:10.637247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a1722-d340-423e-a7aa-6b47d0c4a1c0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:10.648918 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 364/754] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:10.660819 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1722-d340-423e-a7aa-6b47d0c4a1c0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:10.806442 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a292aa0-89a4-4d9a-8592-6cc4ffc1d628 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:10.825685 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:10.858950 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276dd65-46ba-4bb5-8bc9-729771a770df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:10.859761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276dd65-46ba-4bb5-8bc9-729771a770df None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.860044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276dd65-46ba-4bb5-8bc9-729771a770df None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.860318 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276dd65-46ba-4bb5-8bc9-729771a770df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.861863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1722-d340-423e-a7aa-6b47d0c4a1c0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:10.871594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276dd65-46ba-4bb5-8bc9-729771a770df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:10.873251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276dd65-46ba-4bb5-8bc9-729771a770df None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-3276dd65-46ba-4bb5-8bc9-729771a770df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:10.891252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:10.892390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:10.893351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:10.893351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:10.893351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:10.893351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:10.897391 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 391/755] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:10.898650 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276dd65-46ba-4bb5-8bc9-729771a770df None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:10.914855 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:10.988298 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d38da9-da6f-4c55-8fef-34140f21f804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:10.989130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d38da9-da6f-4c55-8fef-34140f21f804 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.989438 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d38da9-da6f-4c55-8fef-34140f21f804 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.989719 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d38da9-da6f-4c55-8fef-34140f21f804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.000291 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276dd65-46ba-4bb5-8bc9-729771a770df None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.006531 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d38da9-da6f-4c55-8fef-34140f21f804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.008036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d38da9-da6f-4c55-8fef-34140f21f804 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-62d38da9-da6f-4c55-8fef-34140f21f804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:11.034428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:11.035797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:11.036692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:11.036692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:11.036692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:11.036692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:11.036692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:11.036692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:11.036692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:11.036692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:11.037229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e28664-f81a-4a63-b026-ef5fb811788f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.037229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e28664-f81a-4a63-b026-ef5fb811788f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.037229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e28664-f81a-4a63-b026-ef5fb811788f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.037229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e28664-f81a-4a63-b026-ef5fb811788f None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.037517 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 365/756] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:11.040884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e28664-f81a-4a63-b026-ef5fb811788f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:11.041222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e28664-f81a-4a63-b026-ef5fb811788f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.042694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e28664-f81a-4a63-b026-ef5fb811788f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.050124 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d38da9-da6f-4c55-8fef-34140f21f804 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.060233 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 392/757] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:11.061459 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e28664-f81a-4a63-b026-ef5fb811788f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.097608 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.166043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e28664-f81a-4a63-b026-ef5fb811788f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.207188 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199d257-0c65-410e-8eb7-f66c9db696c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199d257-0c65-410e-8eb7-f66c9db696c2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.208287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199d257-0c65-410e-8eb7-f66c9db696c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.208559 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199d257-0c65-410e-8eb7-f66c9db696c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.216655 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199d257-0c65-410e-8eb7-f66c9db696c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.218549 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199d257-0c65-410e-8eb7-f66c9db696c2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-d199d257-0c65-410e-8eb7-f66c9db696c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:11.233721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:11.234705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:11.235676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:11.235676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:11.235676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:11.235676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:11.235676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:11.235676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:11.235676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:11.235676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:11.235676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:11.235676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:11.240013 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 393/758] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:11.241765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199d257-0c65-410e-8eb7-f66c9db696c2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.333057 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.350012 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199d257-0c65-410e-8eb7-f66c9db696c2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.372118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d38da9-da6f-4c55-8fef-34140f21f804 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.389842 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5269d0a-e9bd-4de0-86e6-d094ae2b527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.390894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5269d0a-e9bd-4de0-86e6-d094ae2b527d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.391276 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5269d0a-e9bd-4de0-86e6-d094ae2b527d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.391669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5269d0a-e9bd-4de0-86e6-d094ae2b527d None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.393496 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5269d0a-e9bd-4de0-86e6-d094ae2b527d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:11.393910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5269d0a-e9bd-4de0-86e6-d094ae2b527d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.395895 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5269d0a-e9bd-4de0-86e6-d094ae2b527d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.422089 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 394/759] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:11.423730 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5269d0a-e9bd-4de0-86e6-d094ae2b527d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.439142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78c4b3-bed3-4b19-bfb5-1059bb3aeeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.439816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78c4b3-bed3-4b19-bfb5-1059bb3aeeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.440095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78c4b3-bed3-4b19-bfb5-1059bb3aeeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.440365 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78c4b3-bed3-4b19-bfb5-1059bb3aeeb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.441164 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78c4b3-bed3-4b19-bfb5-1059bb3aeeb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:11.441504 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78c4b3-bed3-4b19-bfb5-1059bb3aeeb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.442957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78c4b3-bed3-4b19-bfb5-1059bb3aeeb2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.455757 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 366/760] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:11.457130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3264-d45d-426b-8842-9f5684ff32dd None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.457439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3264-d45d-426b-8842-9f5684ff32dd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.457711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3264-d45d-426b-8842-9f5684ff32dd None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.463386 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 367/761] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:11.464548 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11186447-97c8-405a-85e1-aa97ee157ab9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.464885 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11186447-97c8-405a-85e1-aa97ee157ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.465161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11186447-97c8-405a-85e1-aa97ee157ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.481937 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-11186447-97c8-405a-85e1-aa97ee157ab9 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:11.483344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-11186447-97c8-405a-85e1-aa97ee157ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:11.513289 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.548798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5269d0a-e9bd-4de0-86e6-d094ae2b527d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.553877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 368/762] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:11.554807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11186447-97c8-405a-85e1-aa97ee157ab9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.585834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e89bc9-ee14-4efc-8413-4253710e93e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.586748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e89bc9-ee14-4efc-8413-4253710e93e2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.587141 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e89bc9-ee14-4efc-8413-4253710e93e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.587471 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e89bc9-ee14-4efc-8413-4253710e93e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.599967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e89bc9-ee14-4efc-8413-4253710e93e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.601831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e89bc9-ee14-4efc-8413-4253710e93e2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.604935 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-81e89bc9-ee14-4efc-8413-4253710e93e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:11.627822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:11.633326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:11.635134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:11.635134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:11.635134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:11.635134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:11.635134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 395/763] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:11.635134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e89bc9-ee14-4efc-8413-4253710e93e2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.698324 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11186447-97c8-405a-85e1-aa97ee157ab9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.732902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8a92d-40b3-4c8a-9f7d-bba6bd1e40bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.733607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8a92d-40b3-4c8a-9f7d-bba6bd1e40bf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.733886 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8a92d-40b3-4c8a-9f7d-bba6bd1e40bf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.734155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8a92d-40b3-4c8a-9f7d-bba6bd1e40bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.734985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8a92d-40b3-4c8a-9f7d-bba6bd1e40bf None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=bd9e9ad3ecec40b9a3c88a5f2b8fdfe2) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:11.735296 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8a92d-40b3-4c8a-9f7d-bba6bd1e40bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.736731 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8a92d-40b3-4c8a-9f7d-bba6bd1e40bf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.742729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 369/764] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/role_assignments?user.id=bd9e9ad3ecec40b9a3c88a5f2b8fdfe2&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:11.743516 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8a92d-40b3-4c8a-9f7d-bba6bd1e40bf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.776464 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e89bc9-ee14-4efc-8413-4253710e93e2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.818663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dc2f2-2ea2-457b-a5e9-b66c0d9f21b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.819499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dc2f2-2ea2-457b-a5e9-b66c0d9f21b3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.819779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dc2f2-2ea2-457b-a5e9-b66c0d9f21b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.820058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dc2f2-2ea2-457b-a5e9-b66c0d9f21b3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.820732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dc2f2-2ea2-457b-a5e9-b66c0d9f21b3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.822843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dc2f2-2ea2-457b-a5e9-b66c0d9f21b3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.826303 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-353dc2f2-2ea2-457b-a5e9-b66c0d9f21b3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:11.846500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:11.848861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:11.850910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:11.856345 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 396/765] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:11.857415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dc2f2-2ea2-457b-a5e9-b66c0d9f21b3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.957786 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8a92d-40b3-4c8a-9f7d-bba6bd1e40bf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.976702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.999068 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ded383-d202-47e8-a582-c91ba820ea7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.000160 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ded383-d202-47e8-a582-c91ba820ea7e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.000856 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ded383-d202-47e8-a582-c91ba820ea7e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.002197 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ded383-d202-47e8-a582-c91ba820ea7e None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.003168 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ded383-d202-47e8-a582-c91ba820ea7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:12.008332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ded383-d202-47e8-a582-c91ba820ea7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.010156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ded383-d202-47e8-a582-c91ba820ea7e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.032777 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 370/766] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:12.039820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ded383-d202-47e8-a582-c91ba820ea7e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.041345 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dc2f2-2ea2-457b-a5e9-b66c0d9f21b3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.106585 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0efa94-b0ad-4ec0-8ea0-ab3282b9e9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.107322 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0efa94-b0ad-4ec0-8ea0-ab3282b9e9bb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.108007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0efa94-b0ad-4ec0-8ea0-ab3282b9e9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.108284 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0efa94-b0ad-4ec0-8ea0-ab3282b9e9bb None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.109354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0efa94-b0ad-4ec0-8ea0-ab3282b9e9bb None admin] RBAC: Adding query filter params (name=network) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:12.109663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0efa94-b0ad-4ec0-8ea0-ab3282b9e9bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.111776 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0efa94-b0ad-4ec0-8ea0-ab3282b9e9bb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.122401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 397/767] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:12.128089 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0efa94-b0ad-4ec0-8ea0-ab3282b9e9bb None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.191831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:12.212086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ded383-d202-47e8-a582-c91ba820ea7e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.277747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932be032-b755-4041-b87f-ffdf9788c8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.278559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932be032-b755-4041-b87f-ffdf9788c8ae None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.279135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932be032-b755-4041-b87f-ffdf9788c8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.279412 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932be032-b755-4041-b87f-ffdf9788c8ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932be032-b755-4041-b87f-ffdf9788c8ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.296356 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932be032-b755-4041-b87f-ffdf9788c8ae None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.307603 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0efa94-b0ad-4ec0-8ea0-ab3282b9e9bb None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-932be032-b755-4041-b87f-ffdf9788c8ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:12.311146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:12.312028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:12.312959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:12.312959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:12.312959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:12.312959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:12.312959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:12.312959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:12.312959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:12.312959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:12.312959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 371/768] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:12.334274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932be032-b755-4041-b87f-ffdf9788c8ae None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.349572 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:12.357164 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cec983-a061-4c40-9131-21e12fef831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.358029 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cec983-a061-4c40-9131-21e12fef831a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.358327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cec983-a061-4c40-9131-21e12fef831a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.358602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cec983-a061-4c40-9131-21e12fef831a None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.359813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cec983-a061-4c40-9131-21e12fef831a None admin] RBAC: Adding query filter params (type=network) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:12.360128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cec983-a061-4c40-9131-21e12fef831a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.361545 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cec983-a061-4c40-9131-21e12fef831a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.367376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 398/769] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:12.374869 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cec983-a061-4c40-9131-21e12fef831a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.515754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cec983-a061-4c40-9131-21e12fef831a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.526716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932be032-b755-4041-b87f-ffdf9788c8ae None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.558592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13413b7d-bb94-4a8d-b7b5-3138702bf8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.559425 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13413b7d-bb94-4a8d-b7b5-3138702bf8db None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.559709 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13413b7d-bb94-4a8d-b7b5-3138702bf8db None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.560000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13413b7d-bb94-4a8d-b7b5-3138702bf8db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.561433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13413b7d-bb94-4a8d-b7b5-3138702bf8db None admin] RBAC: Adding query filter params (interface=public, service_id=a3179114ddb54134a006c510e44ea186, region_id=RegionOne) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:12.561751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13413b7d-bb94-4a8d-b7b5-3138702bf8db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.563565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13413b7d-bb94-4a8d-b7b5-3138702bf8db None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.567982 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90fe09-d203-4043-b21e-f1ebc846f695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.569190 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90fe09-d203-4043-b21e-f1ebc846f695 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.569515 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90fe09-d203-4043-b21e-f1ebc846f695 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.569792 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90fe09-d203-4043-b21e-f1ebc846f695 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.570601 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90fe09-d203-4043-b21e-f1ebc846f695 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:12.570911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90fe09-d203-4043-b21e-f1ebc846f695 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.572542 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90fe09-d203-4043-b21e-f1ebc846f695 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.575355 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 399/770] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/endpoints?service_id=a3179114ddb54134a006c510e44ea186&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:12.576757 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb057838-2aef-411d-9b96-3d5bc5333073 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.577048 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb057838-2aef-411d-9b96-3d5bc5333073 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.577367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb057838-2aef-411d-9b96-3d5bc5333073 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.581258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 400/771] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:12.581258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da5679-49f5-47a2-82df-ab42a84c5f02 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.581258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da5679-49f5-47a2-82df-ab42a84c5f02 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.581258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da5679-49f5-47a2-82df-ab42a84c5f02 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.586003 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 401/772] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:12.586837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da5679-49f5-47a2-82df-ab42a84c5f02 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.597244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 372/773] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:12.599303 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982c579-392f-4c42-b8fc-c5a9de8e037d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.600120 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982c579-392f-4c42-b8fc-c5a9de8e037d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.600606 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982c579-392f-4c42-b8fc-c5a9de8e037d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.618356 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e982c579-392f-4c42-b8fc-c5a9de8e037d None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:12.619478 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e982c579-392f-4c42-b8fc-c5a9de8e037d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:12.623001 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:12.640863 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:12.697229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 373/774] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:12.697229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c74ce9-1aea-40d7-908e-03d1071491b0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.697229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c74ce9-1aea-40d7-908e-03d1071491b0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.697229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c74ce9-1aea-40d7-908e-03d1071491b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.700881 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da5679-49f5-47a2-82df-ab42a84c5f02 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.713559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-58c74ce9-1aea-40d7-908e-03d1071491b0 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:12.715307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-58c74ce9-1aea-40d7-908e-03d1071491b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:12.737637 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492a361-3904-4f16-b4a9-d0b499ad926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.738714 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492a361-3904-4f16-b4a9-d0b499ad926e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.739027 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492a361-3904-4f16-b4a9-d0b499ad926e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.739281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492a361-3904-4f16-b4a9-d0b499ad926e None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.739970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492a361-3904-4f16-b4a9-d0b499ad926e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492a361-3904-4f16-b4a9-d0b499ad926e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.746723 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 402/775] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:12.747311 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492a361-3904-4f16-b4a9-d0b499ad926e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.809586 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 374/776] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:12.810657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c74ce9-1aea-40d7-908e-03d1071491b0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.868733 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492a361-3904-4f16-b4a9-d0b499ad926e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.885899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:12.902919 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:12.910642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e1c7e-ec54-4a21-bc75-eeb7a4babe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.911961 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e1c7e-ec54-4a21-bc75-eeb7a4babe76 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.912450 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e1c7e-ec54-4a21-bc75-eeb7a4babe76 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.912733 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e1c7e-ec54-4a21-bc75-eeb7a4babe76 None admin] PATH_INFO: `/v3/projects/f5b7f081bd694cce90cca76194df476e/users/808b08d1d2df42e587279071a5dba593/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.915505 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e1c7e-ec54-4a21-bc75-eeb7a4babe76 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7f081bd694cce90cca76194df476e, user_id=808b08d1d2df42e587279071a5dba593, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.916177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e1c7e-ec54-4a21-bc75-eeb7a4babe76 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.933869 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 403/777] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:53:12 2022] PUT /identity/v3/projects/f5b7f081bd694cce90cca76194df476e/users/808b08d1d2df42e587279071a5dba593/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:53:12.934721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e1c7e-ec54-4a21-bc75-eeb7a4babe76 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.942989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c74ce9-1aea-40d7-908e-03d1071491b0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.987140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d56bd-4c56-4118-9710-43aafc28aae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.988021 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d56bd-4c56-4118-9710-43aafc28aae5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.989080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d56bd-4c56-4118-9710-43aafc28aae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.989471 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d56bd-4c56-4118-9710-43aafc28aae5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.990182 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d56bd-4c56-4118-9710-43aafc28aae5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.991621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d56bd-4c56-4118-9710-43aafc28aae5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-d84d56bd-4c56-4118-9710-43aafc28aae5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:13.008536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:13.009774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:13.011156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:13.018909 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 375/778] 10.222.0.43 () {56 vars in 1129 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:13.021725 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d56bd-4c56-4118-9710-43aafc28aae5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.181718 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e1c7e-ec54-4a21-bc75-eeb7a4babe76 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:13.198371 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d56bd-4c56-4118-9710-43aafc28aae5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:13.236043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432553d-7713-413d-99e8-44f540853e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.237143 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432553d-7713-413d-99e8-44f540853e55 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.237603 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432553d-7713-413d-99e8-44f540853e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.238023 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432553d-7713-413d-99e8-44f540853e55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.255284 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432553d-7713-413d-99e8-44f540853e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-a432553d-7713-413d-99e8-44f540853e55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:13.264165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:13.265325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:13.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:13.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:13.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:13.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:13.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:13.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:13.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:13.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:13.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:13.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:13.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:13.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:13.268116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb57af-60a9-4bc2-aa1d-2e419f910c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.268963 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb57af-60a9-4bc2-aa1d-2e419f910c41 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.269407 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb57af-60a9-4bc2-aa1d-2e419f910c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.269875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb57af-60a9-4bc2-aa1d-2e419f910c41 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.270805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb57af-60a9-4bc2-aa1d-2e419f910c41 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:13.271261 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb57af-60a9-4bc2-aa1d-2e419f910c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:13.272813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb57af-60a9-4bc2-aa1d-2e419f910c41 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.276584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:13.279431 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 376/779] 10.222.0.43 () {56 vars in 1124 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:13.279716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 404/780] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:13.283810 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb57af-60a9-4bc2-aa1d-2e419f910c41 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.286906 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432553d-7713-413d-99e8-44f540853e55 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.383824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:13.415209 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb57af-60a9-4bc2-aa1d-2e419f910c41 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:13.486737 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f5aff-169c-48f8-9945-6bdbe6a963b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.487336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f5aff-169c-48f8-9945-6bdbe6a963b1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.487612 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f5aff-169c-48f8-9945-6bdbe6a963b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.487882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f5aff-169c-48f8-9945-6bdbe6a963b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.488638 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f5aff-169c-48f8-9945-6bdbe6a963b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:13.492491 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f5aff-169c-48f8-9945-6bdbe6a963b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:13.493941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f5aff-169c-48f8-9945-6bdbe6a963b1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.513594 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 377/781] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:13.519383 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f5aff-169c-48f8-9945-6bdbe6a963b1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.521642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432553d-7713-413d-99e8-44f540853e55 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:13.581241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47581f2-7cf9-4f30-b062-32022d1cec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.582688 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47581f2-7cf9-4f30-b062-32022d1cec30 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.583158 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47581f2-7cf9-4f30-b062-32022d1cec30 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.583718 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47581f2-7cf9-4f30-b062-32022d1cec30 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.585164 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47581f2-7cf9-4f30-b062-32022d1cec30 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:13.585673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47581f2-7cf9-4f30-b062-32022d1cec30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:13.587916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47581f2-7cf9-4f30-b062-32022d1cec30 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.596336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 405/782] 10.222.0.43 () {56 vars in 1124 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:13.602337 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47581f2-7cf9-4f30-b062-32022d1cec30 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.651639 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:13.738774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f5aff-169c-48f8-9945-6bdbe6a963b1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:13.781221 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:13.785875 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47581f2-7cf9-4f30-b062-32022d1cec30 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:13.807628 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de0e10-7fa6-4d5d-9bb1-3ad0a52c6966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.808490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de0e10-7fa6-4d5d-9bb1-3ad0a52c6966 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.808774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de0e10-7fa6-4d5d-9bb1-3ad0a52c6966 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.809045 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de0e10-7fa6-4d5d-9bb1-3ad0a52c6966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.830145 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de0e10-7fa6-4d5d-9bb1-3ad0a52c6966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:13.831875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de0e10-7fa6-4d5d-9bb1-3ad0a52c6966 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.857967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0889c-f365-438e-b6ee-ebf0a9e70fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.858658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0889c-f365-438e-b6ee-ebf0a9e70fef None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.858952 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0889c-f365-438e-b6ee-ebf0a9e70fef None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.859243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0889c-f365-438e-b6ee-ebf0a9e70fef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.860046 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0889c-f365-438e-b6ee-ebf0a9e70fef None admin] RBAC: Adding query filter params (interface=public, service_id=3804945d828749329518e941883ce1e8, region_id=RegionOne) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-e0de0e10-7fa6-4d5d-9bb1-3ad0a52c6966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:13.860335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:13.861215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:13.862135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:13.862135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:13.862135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:13.862135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:13.862371 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0889c-f365-438e-b6ee-ebf0a9e70fef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:13.862371 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0889c-f365-438e-b6ee-ebf0a9e70fef None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.862524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 378/783] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:13.870688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de0e10-7fa6-4d5d-9bb1-3ad0a52c6966 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.874417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 406/784] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/endpoints?service_id=3804945d828749329518e941883ce1e8&interface=public®ion_id=RegionOne => generated 194 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:13.875358 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0889c-f365-438e-b6ee-ebf0a9e70fef None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.010187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de0e10-7fa6-4d5d-9bb1-3ad0a52c6966 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.024655 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:14.039540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0889c-f365-438e-b6ee-ebf0a9e70fef None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.047399 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f67218-46e1-488b-a755-a11f7c17b160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.048069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f67218-46e1-488b-a755-a11f7c17b160 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.048348 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f67218-46e1-488b-a755-a11f7c17b160 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.048617 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f67218-46e1-488b-a755-a11f7c17b160 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.049435 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f67218-46e1-488b-a755-a11f7c17b160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:14.049738 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f67218-46e1-488b-a755-a11f7c17b160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:14.051115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f67218-46e1-488b-a755-a11f7c17b160 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:14.063301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 379/785] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:14.064551 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98128-7ba0-42af-90a7-21fb84c745f3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.064833 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98128-7ba0-42af-90a7-21fb84c745f3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.065108 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98128-7ba0-42af-90a7-21fb84c745f3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.070579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 380/786] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:14.076084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac30fc-464f-401e-8cfa-9368d98b6640 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.076084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac30fc-464f-401e-8cfa-9368d98b6640 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.076084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac30fc-464f-401e-8cfa-9368d98b6640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.081337 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08446c-e4aa-4e07-bceb-8e5bab022f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.082249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08446c-e4aa-4e07-bceb-8e5bab022f31 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.082720 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08446c-e4aa-4e07-bceb-8e5bab022f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.083172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08446c-e4aa-4e07-bceb-8e5bab022f31 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.084029 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08446c-e4aa-4e07-bceb-8e5bab022f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:14.086068 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08446c-e4aa-4e07-bceb-8e5bab022f31 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:14.091957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-90ac30fc-464f-401e-8cfa-9368d98b6640 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:14.092168 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 407/787] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:14.093007 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-90ac30fc-464f-401e-8cfa-9368d98b6640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:14.093399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08446c-e4aa-4e07-bceb-8e5bab022f31 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.145245 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:14.179583 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 381/788] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:14.234645 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac30fc-464f-401e-8cfa-9368d98b6640 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.282151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08446c-e4aa-4e07-bceb-8e5bab022f31 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.325246 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81efc8-4305-444a-a7c7-43a5d1993345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.326702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81efc8-4305-444a-a7c7-43a5d1993345 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.326988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81efc8-4305-444a-a7c7-43a5d1993345 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.327265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81efc8-4305-444a-a7c7-43a5d1993345 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.338166 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81efc8-4305-444a-a7c7-43a5d1993345 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:14.340179 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81efc8-4305-444a-a7c7-43a5d1993345 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:14.355348 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac30fc-464f-401e-8cfa-9368d98b6640 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.357154 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-5a81efc8-4305-444a-a7c7-43a5d1993345 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:14.364763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:14.365783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:14.366767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:14.366767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:14.366767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:14.366767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:14.366767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:14.366767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:14.366767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:14.366767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:14.366767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:14.366767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:14.367543 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 408/789] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Jul 24 00:53:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:14.378188 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81efc8-4305-444a-a7c7-43a5d1993345 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.415557 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0b5cc-8b74-4fb0-b144-5c1177d425e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.416373 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0b5cc-8b74-4fb0-b144-5c1177d425e1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.416647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0b5cc-8b74-4fb0-b144-5c1177d425e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.416914 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0b5cc-8b74-4fb0-b144-5c1177d425e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.433591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0b5cc-8b74-4fb0-b144-5c1177d425e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-76b0b5cc-8b74-4fb0-b144-5c1177d425e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:14.441232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:14.442162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:14.443090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:14.443090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:14.443090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:14.443090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:14.443090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:14.443090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:14.443090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:14.443090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:14.443090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:14.443090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:14.443090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:14.443090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:14.452584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 382/790] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:14.457093 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0b5cc-8b74-4fb0-b144-5c1177d425e1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.540419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:14.568272 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81efc8-4305-444a-a7c7-43a5d1993345 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.630960 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0b5cc-8b74-4fb0-b144-5c1177d425e1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.647861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f1199-9047-4513-86ef-a781ad2282bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.648545 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f1199-9047-4513-86ef-a781ad2282bc None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.648822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f1199-9047-4513-86ef-a781ad2282bc None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.649090 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f1199-9047-4513-86ef-a781ad2282bc None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.649971 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f1199-9047-4513-86ef-a781ad2282bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:14.650276 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f1199-9047-4513-86ef-a781ad2282bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:14.651719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f1199-9047-4513-86ef-a781ad2282bc None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:14.682334 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 409/791] 10.222.0.43 () {56 vars in 1149 bytes} [Sun Jul 24 00:53:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:14.687899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f1199-9047-4513-86ef-a781ad2282bc None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.694863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547effb-6689-4209-a486-0379bafa1abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.695547 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547effb-6689-4209-a486-0379bafa1abb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.695827 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547effb-6689-4209-a486-0379bafa1abb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.696104 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547effb-6689-4209-a486-0379bafa1abb None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.696858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547effb-6689-4209-a486-0379bafa1abb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:14.697167 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547effb-6689-4209-a486-0379bafa1abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:14.698578 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547effb-6689-4209-a486-0379bafa1abb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:14.722839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 383/792] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:14.728002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547effb-6689-4209-a486-0379bafa1abb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.804312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:14.837825 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f1199-9047-4513-86ef-a781ad2282bc None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.901334 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fd3a7-93d3-479d-abfb-fc71efb08f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.906081 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fd3a7-93d3-479d-abfb-fc71efb08f43 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fd3a7-93d3-479d-abfb-fc71efb08f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.907077 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fd3a7-93d3-479d-abfb-fc71efb08f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.928444 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fd3a7-93d3-479d-abfb-fc71efb08f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:14.932120 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fd3a7-93d3-479d-abfb-fc71efb08f43 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:14.945555 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-520fd3a7-93d3-479d-abfb-fc71efb08f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:14.962616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:14.963567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:14.964448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:14.964448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:14.964448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:14.964448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:14.968267 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547effb-6689-4209-a486-0379bafa1abb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.979173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 410/793] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:14.984639 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fd3a7-93d3-479d-abfb-fc71efb08f43 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.034352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd38da-c506-46d9-9737-2d316a885b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.035170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd38da-c506-46d9-9737-2d316a885b9d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.035454 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd38da-c506-46d9-9737-2d316a885b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.035729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd38da-c506-46d9-9737-2d316a885b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.050536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd38da-c506-46d9-9737-2d316a885b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.052007 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd38da-c506-46d9-9737-2d316a885b9d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-0cbd38da-c506-46d9-9737-2d316a885b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:15.075127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:15.076388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:15.077545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:15.077545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:15.077545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:15.077545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:15.079845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 384/794] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:15.086001 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d8ca1-565f-4a05-9363-a8a14945936e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.086473 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d8ca1-565f-4a05-9363-a8a14945936e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.086901 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d8ca1-565f-4a05-9363-a8a14945936e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.088613 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 385/795] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:15.090568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d8ca1-565f-4a05-9363-a8a14945936e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.131252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fd3a7-93d3-479d-abfb-fc71efb08f43 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.167580 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d41c1-0dd8-4058-98dd-4aca3fbd33f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.168410 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d41c1-0dd8-4058-98dd-4aca3fbd33f4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.168800 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d41c1-0dd8-4058-98dd-4aca3fbd33f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.169266 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d41c1-0dd8-4058-98dd-4aca3fbd33f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.170192 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d41c1-0dd8-4058-98dd-4aca3fbd33f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:15.170565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d41c1-0dd8-4058-98dd-4aca3fbd33f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.172011 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d41c1-0dd8-4058-98dd-4aca3fbd33f4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.172631 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:15.187893 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 411/796] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:15.190094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012ef1-5ec2-47b9-bbb9-b19d4342a48a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.190798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012ef1-5ec2-47b9-bbb9-b19d4342a48a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.191363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012ef1-5ec2-47b9-bbb9-b19d4342a48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.199105 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d8ca1-565f-4a05-9363-a8a14945936e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.214759 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-f0012ef1-5ec2-47b9-bbb9-b19d4342a48a None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:15.216243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f0012ef1-5ec2-47b9-bbb9-b19d4342a48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:15.236532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f6c22-0e37-449f-8c3b-ea5056a135fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.237876 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f6c22-0e37-449f-8c3b-ea5056a135fe None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.238339 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f6c22-0e37-449f-8c3b-ea5056a135fe None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.238790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f6c22-0e37-449f-8c3b-ea5056a135fe None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.239800 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f6c22-0e37-449f-8c3b-ea5056a135fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:15.240316 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f6c22-0e37-449f-8c3b-ea5056a135fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.241899 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f6c22-0e37-449f-8c3b-ea5056a135fe None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.260073 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 386/797] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:15.261353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f6c22-0e37-449f-8c3b-ea5056a135fe None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.272085 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:15.297301 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 412/798] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:15.298299 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0012ef1-5ec2-47b9-bbb9-b19d4342a48a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.370116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f6c22-0e37-449f-8c3b-ea5056a135fe None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.404701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0012ef1-5ec2-47b9-bbb9-b19d4342a48a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.407603 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110fe66-3e2b-41d8-8910-3fd021891ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.408619 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110fe66-3e2b-41d8-8910-3fd021891ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.409108 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110fe66-3e2b-41d8-8910-3fd021891ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.409596 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110fe66-3e2b-41d8-8910-3fd021891ba5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.412720 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:15.418550 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110fe66-3e2b-41d8-8910-3fd021891ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.420480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110fe66-3e2b-41d8-8910-3fd021891ba5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-2110fe66-3e2b-41d8-8910-3fd021891ba5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:15.436234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:15.437237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:15.438155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:15.438155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:15.438155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:15.438155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:15.438155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:15.438155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:15.438155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:15.438155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:15.439146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 387/799] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:15.440018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac673ca-668b-496b-985e-ab8e8d37ea05 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.440304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac673ca-668b-496b-985e-ab8e8d37ea05 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.440573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac673ca-668b-496b-985e-ab8e8d37ea05 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.442189 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 388/800] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:15.442901 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac673ca-668b-496b-985e-ab8e8d37ea05 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.449496 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af845c77-626c-40c1-856e-90c892f07898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.450650 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845c77-626c-40c1-856e-90c892f07898 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.451119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845c77-626c-40c1-856e-90c892f07898 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.451572 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845c77-626c-40c1-856e-90c892f07898 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.461443 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af845c77-626c-40c1-856e-90c892f07898 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.462888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af845c77-626c-40c1-856e-90c892f07898 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-af845c77-626c-40c1-856e-90c892f07898 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:15.477456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:15.478429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:15.479394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:15.479394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:15.479394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:15.479394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:15.479394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:15.479394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:15.479394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:15.479394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:15.479394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:15.479394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:15.479394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 413/801] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:15.479987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab6b61-08d6-4224-b3dc-efedcc897951 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.480685 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab6b61-08d6-4224-b3dc-efedcc897951 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.480685 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab6b61-08d6-4224-b3dc-efedcc897951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.496469 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-85ab6b61-08d6-4224-b3dc-efedcc897951 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:15.497726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-85ab6b61-08d6-4224-b3dc-efedcc897951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:15.542049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:15.563542 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac673ca-668b-496b-985e-ab8e8d37ea05 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.577357 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 414/802] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:15.578726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab6b61-08d6-4224-b3dc-efedcc897951 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.600525 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd758de7-df98-4bea-86bc-e42c29e7d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.601628 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd758de7-df98-4bea-86bc-e42c29e7d97d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.601912 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd758de7-df98-4bea-86bc-e42c29e7d97d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.602199 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd758de7-df98-4bea-86bc-e42c29e7d97d None admin] PATH_INFO: `/v3/services/network` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.602888 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd758de7-df98-4bea-86bc-e42c29e7d97d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.604269 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd758de7-df98-4bea-86bc-e42c29e7d97d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-cd758de7-df98-4bea-86bc-e42c29e7d97d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:15.616215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:15.617186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:15.622347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 389/803] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:15.623152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd758de7-df98-4bea-86bc-e42c29e7d97d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.686777 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:15.692813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab6b61-08d6-4224-b3dc-efedcc897951 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.728711 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39949b89-ff62-4880-bf93-a358b270671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.729404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39949b89-ff62-4880-bf93-a358b270671e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.729690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39949b89-ff62-4880-bf93-a358b270671e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.729946 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39949b89-ff62-4880-bf93-a358b270671e None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.730755 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39949b89-ff62-4880-bf93-a358b270671e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:15.731055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39949b89-ff62-4880-bf93-a358b270671e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.732546 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39949b89-ff62-4880-bf93-a358b270671e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.733432 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd758de7-df98-4bea-86bc-e42c29e7d97d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.743922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 415/804] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:15.744705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39949b89-ff62-4880-bf93-a358b270671e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.773137 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed8a5b-e638-42e8-ac69-60baed4ab30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.774137 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed8a5b-e638-42e8-ac69-60baed4ab30e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.774602 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed8a5b-e638-42e8-ac69-60baed4ab30e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.775095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed8a5b-e638-42e8-ac69-60baed4ab30e None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.776018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed8a5b-e638-42e8-ac69-60baed4ab30e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:15.776331 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed8a5b-e638-42e8-ac69-60baed4ab30e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.777820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed8a5b-e638-42e8-ac69-60baed4ab30e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.783457 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:15.797051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 390/805] 10.222.0.43 () {56 vars in 1135 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:15.797925 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed8a5b-e638-42e8-ac69-60baed4ab30e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.857091 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39949b89-ff62-4880-bf93-a358b270671e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.895319 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d4d9c-474e-48ef-8813-93fa0614b4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.896041 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d4d9c-474e-48ef-8813-93fa0614b4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.896320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d4d9c-474e-48ef-8813-93fa0614b4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.896590 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d4d9c-474e-48ef-8813-93fa0614b4f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.902415 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed8a5b-e638-42e8-ac69-60baed4ab30e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.907171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d4d9c-474e-48ef-8813-93fa0614b4f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-272d4d9c-474e-48ef-8813-93fa0614b4f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:15.914748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:15.915921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 416/806] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:15.916792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d4d9c-474e-48ef-8813-93fa0614b4f4 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.928231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:15.946540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628ebc6-52a6-45c9-8b82-6be79621e40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.947205 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ebc6-52a6-45c9-8b82-6be79621e40d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.947488 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ebc6-52a6-45c9-8b82-6be79621e40d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.947766 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ebc6-52a6-45c9-8b82-6be79621e40d None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.948473 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628ebc6-52a6-45c9-8b82-6be79621e40d None admin] RBAC: Adding query filter params (name=network) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:15.948781 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628ebc6-52a6-45c9-8b82-6be79621e40d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.950183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628ebc6-52a6-45c9-8b82-6be79621e40d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.954760 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 391/807] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:15.955530 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628ebc6-52a6-45c9-8b82-6be79621e40d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.023750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:16.030504 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d4d9c-474e-48ef-8813-93fa0614b4f4 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.062615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628ebc6-52a6-45c9-8b82-6be79621e40d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.067571 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b83fd-9c2d-4065-985d-38590beca33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:16.068689 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b83fd-9c2d-4065-985d-38590beca33b None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.069152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b83fd-9c2d-4065-985d-38590beca33b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.069647 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b83fd-9c2d-4065-985d-38590beca33b None admin] PATH_INFO: `/v3/projects/f5b7f081bd694cce90cca76194df476e/users/8a465bdbfe3248679adc15154a152d23/roles/ce064f563f9340c9863b6ec5bb273c39` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.085894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b83fd-9c2d-4065-985d-38590beca33b None admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7f081bd694cce90cca76194df476e, user_id=8a465bdbfe3248679adc15154a152d23, role_id=ce064f563f9340c9863b6ec5bb273c39)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:16.087610 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b83fd-9c2d-4065-985d-38590beca33b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:16.098212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99add1-16ba-4d35-b9da-b7db86f8876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:16.099015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99add1-16ba-4d35-b9da-b7db86f8876f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.099291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99add1-16ba-4d35-b9da-b7db86f8876f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.099561 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99add1-16ba-4d35-b9da-b7db86f8876f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.103105 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 417/808] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:53:15 2022] PUT /identity/v3/projects/f5b7f081bd694cce90cca76194df476e/users/8a465bdbfe3248679adc15154a152d23/roles/ce064f563f9340c9863b6ec5bb273c39 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:53:16.104101 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b83fd-9c2d-4065-985d-38590beca33b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.118574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99add1-16ba-4d35-b9da-b7db86f8876f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:16.120199 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99add1-16ba-4d35-b9da-b7db86f8876f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-8e99add1-16ba-4d35-b9da-b7db86f8876f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:16.141485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:16.142518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:16.143510 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:16.143510 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:16.143510 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:16.143510 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:16.147621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 392/809] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:16.148411 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99add1-16ba-4d35-b9da-b7db86f8876f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.191361 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:16.241962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b83fd-9c2d-4065-985d-38590beca33b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.286786 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99add1-16ba-4d35-b9da-b7db86f8876f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.288875 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc7b45-4994-45ed-a669-2eb4859ca4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:16.290141 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc7b45-4994-45ed-a669-2eb4859ca4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.290614 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc7b45-4994-45ed-a669-2eb4859ca4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.291828 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc7b45-4994-45ed-a669-2eb4859ca4f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.292605 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc7b45-4994-45ed-a669-2eb4859ca4f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:16.292913 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc7b45-4994-45ed-a669-2eb4859ca4f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:16.294431 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc7b45-4994-45ed-a669-2eb4859ca4f7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:16.304612 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 418/810] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:16.305365 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc7b45-4994-45ed-a669-2eb4859ca4f7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.317741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:16.336119 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285d115-ab8d-40ee-a998-a58eba2862ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:16.337373 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285d115-ab8d-40ee-a998-a58eba2862ae None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.338054 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285d115-ab8d-40ee-a998-a58eba2862ae None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.338919 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285d115-ab8d-40ee-a998-a58eba2862ae None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.340048 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285d115-ab8d-40ee-a998-a58eba2862ae None admin] RBAC: Adding query filter params (type=network) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:16.340498 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285d115-ab8d-40ee-a998-a58eba2862ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:16.343127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285d115-ab8d-40ee-a998-a58eba2862ae None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:16.354825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 393/811] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:16.355882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285d115-ab8d-40ee-a998-a58eba2862ae None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.420848 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc7b45-4994-45ed-a669-2eb4859ca4f7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.456864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e96c8-5a7e-41d7-92d4-c025d8ddcd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:16.457573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e96c8-5a7e-41d7-92d4-c025d8ddcd41 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.457858 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e96c8-5a7e-41d7-92d4-c025d8ddcd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.458157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e96c8-5a7e-41d7-92d4-c025d8ddcd41 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.458884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e96c8-5a7e-41d7-92d4-c025d8ddcd41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:16.459976 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e96c8-5a7e-41d7-92d4-c025d8ddcd41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:16.461384 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e96c8-5a7e-41d7-92d4-c025d8ddcd41 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:16.468059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:16.473978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285d115-ab8d-40ee-a998-a58eba2862ae None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.479335 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 419/812] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:16.479335 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e96c8-5a7e-41d7-92d4-c025d8ddcd41 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.510465 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb695a-7a17-4643-95e6-88d56910c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:16.511268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb695a-7a17-4643-95e6-88d56910c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.511550 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb695a-7a17-4643-95e6-88d56910c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.511820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb695a-7a17-4643-95e6-88d56910c2e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb695a-7a17-4643-95e6-88d56910c2e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:16.524793 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb695a-7a17-4643-95e6-88d56910c2e0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-d4bb695a-7a17-4643-95e6-88d56910c2e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:16.542062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:16.543207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:16.549326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:16.549326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:16.549326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:16.549326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:16.549326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 394/813] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:16.549326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb1e95-99a8-43a9-96da-44288b827f1c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.549326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb1e95-99a8-43a9-96da-44288b827f1c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.549326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb1e95-99a8-43a9-96da-44288b827f1c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.549326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 395/814] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:16.549855 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb1e95-99a8-43a9-96da-44288b827f1c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.566301 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:16.610659 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e96c8-5a7e-41d7-92d4-c025d8ddcd41 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.646818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0502d34-73b5-4662-8403-18861d8ddbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:16.647636 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0502d34-73b5-4662-8403-18861d8ddbdd None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.648037 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0502d34-73b5-4662-8403-18861d8ddbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.648665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0502d34-73b5-4662-8403-18861d8ddbdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.649573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0502d34-73b5-4662-8403-18861d8ddbdd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:16.651072 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0502d34-73b5-4662-8403-18861d8ddbdd None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:16.665462 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb1e95-99a8-43a9-96da-44288b827f1c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.674325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 420/815] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:16.675686 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0502d34-73b5-4662-8403-18861d8ddbdd None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.711242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f803b-faba-4bb2-8fee-32326d8c0e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:16.712470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f803b-faba-4bb2-8fee-32326d8c0e3e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.712857 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f803b-faba-4bb2-8fee-32326d8c0e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.713355 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f803b-faba-4bb2-8fee-32326d8c0e3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.722480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f803b-faba-4bb2-8fee-32326d8c0e3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:16.724385 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f803b-faba-4bb2-8fee-32326d8c0e3e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-991f803b-faba-4bb2-8fee-32326d8c0e3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:16.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:16.742979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:16.744085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:16.744085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:16.744085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:16.744085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:16.744085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:16.744085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:16.744085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:16.744085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:16.751631 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 396/816] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:16.753499 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045de5a-044e-4120-a41d-f0ed2fe9b5e0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.753903 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045de5a-044e-4120-a41d-f0ed2fe9b5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.754276 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045de5a-044e-4120-a41d-f0ed2fe9b5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.773700 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:16.776442 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d045de5a-044e-4120-a41d-f0ed2fe9b5e0 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:16.778054 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d045de5a-044e-4120-a41d-f0ed2fe9b5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:16.862252 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 397/817] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:16.863544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045de5a-044e-4120-a41d-f0ed2fe9b5e0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0502d34-73b5-4662-8403-18861d8ddbdd None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.990071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045de5a-044e-4120-a41d-f0ed2fe9b5e0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.991122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:17.003514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64b2eb-28fe-4011-a36b-1b28fbc0e37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.004348 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b2eb-28fe-4011-a36b-1b28fbc0e37f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.004627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b2eb-28fe-4011-a36b-1b28fbc0e37f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.004893 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64b2eb-28fe-4011-a36b-1b28fbc0e37f None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.005649 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64b2eb-28fe-4011-a36b-1b28fbc0e37f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:17.005951 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64b2eb-28fe-4011-a36b-1b28fbc0e37f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.007335 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64b2eb-28fe-4011-a36b-1b28fbc0e37f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.023162 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 421/818] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:17.023162 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64b2eb-28fe-4011-a36b-1b28fbc0e37f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.027144 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4d57c-6e8d-4faf-a120-7217474c2259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.027304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4d57c-6e8d-4faf-a120-7217474c2259 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.027589 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4d57c-6e8d-4faf-a120-7217474c2259 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.027860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4d57c-6e8d-4faf-a120-7217474c2259 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.028714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4d57c-6e8d-4faf-a120-7217474c2259 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:17.029024 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4d57c-6e8d-4faf-a120-7217474c2259 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.030490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4d57c-6e8d-4faf-a120-7217474c2259 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.033088 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:17.047581 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 398/819] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:17.047581 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4d57c-6e8d-4faf-a120-7217474c2259 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.140296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64b2eb-28fe-4011-a36b-1b28fbc0e37f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.152941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4d57c-6e8d-4faf-a120-7217474c2259 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.179856 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b33330-583d-4adb-8234-3f1498d14004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.182548 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b33330-583d-4adb-8234-3f1498d14004 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.182548 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b33330-583d-4adb-8234-3f1498d14004 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.182548 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b33330-583d-4adb-8234-3f1498d14004 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.182548 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b33330-583d-4adb-8234-3f1498d14004 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.183245 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b33330-583d-4adb-8234-3f1498d14004 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-e4b33330-583d-4adb-8234-3f1498d14004 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:17.195607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:17.196528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:17.197399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:17.200122 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d704bfe-709f-4b41-8fd3-efffdc01e06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.200983 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d704bfe-709f-4b41-8fd3-efffdc01e06c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.201290 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d704bfe-709f-4b41-8fd3-efffdc01e06c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.201545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d704bfe-709f-4b41-8fd3-efffdc01e06c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.202086 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 422/820] 10.222.0.43 () {56 vars in 1129 bytes} [Sun Jul 24 00:53:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:17.202639 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b33330-583d-4adb-8234-3f1498d14004 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.211266 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d704bfe-709f-4b41-8fd3-efffdc01e06c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.213238 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d704bfe-709f-4b41-8fd3-efffdc01e06c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9d704bfe-709f-4b41-8fd3-efffdc01e06c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:17.230837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:17.231910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:17.232860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:17.232860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:17.232860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:17.232860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:17.232860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:17.232860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:17.232860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:17.232860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:17.232860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:17.232860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:17.232860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 399/821] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Jul 24 00:53:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:17.232860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d704bfe-709f-4b41-8fd3-efffdc01e06c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.259241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:17.298185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:17.318347 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b33330-583d-4adb-8234-3f1498d14004 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.348515 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d704bfe-709f-4b41-8fd3-efffdc01e06c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.353375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6de443-db7c-41c8-a50c-a9327dab8dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.354308 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6de443-db7c-41c8-a50c-a9327dab8dac None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.354593 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6de443-db7c-41c8-a50c-a9327dab8dac None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.354866 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6de443-db7c-41c8-a50c-a9327dab8dac None admin] PATH_INFO: `/v3/projects/f5b7f081bd694cce90cca76194df476e/users/bd9e9ad3ecec40b9a3c88a5f2b8fdfe2/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.357131 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6de443-db7c-41c8-a50c-a9327dab8dac None admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7f081bd694cce90cca76194df476e, user_id=bd9e9ad3ecec40b9a3c88a5f2b8fdfe2, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.358596 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6de443-db7c-41c8-a50c-a9327dab8dac None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.381249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 423/822] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:53:17 2022] PUT /identity/v3/projects/f5b7f081bd694cce90cca76194df476e/users/bd9e9ad3ecec40b9a3c88a5f2b8fdfe2/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:53:17.381249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6de443-db7c-41c8-a50c-a9327dab8dac None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.398143 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4f21a-55f8-4974-803c-55e9882284a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.398894 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f21a-55f8-4974-803c-55e9882284a1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.399464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f21a-55f8-4974-803c-55e9882284a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.399746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f21a-55f8-4974-803c-55e9882284a1 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.400742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4f21a-55f8-4974-803c-55e9882284a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:17.401130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4f21a-55f8-4974-803c-55e9882284a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.403439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4f21a-55f8-4974-803c-55e9882284a1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.413430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 400/823] 10.222.0.43 () {56 vars in 1124 bytes} [Sun Jul 24 00:53:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:17.418204 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4f21a-55f8-4974-803c-55e9882284a1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.493949 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6de443-db7c-41c8-a50c-a9327dab8dac None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.504515 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:17.540710 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275b88c-3c99-4caa-82e4-34a2917449b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.541812 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275b88c-3c99-4caa-82e4-34a2917449b5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.542361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275b88c-3c99-4caa-82e4-34a2917449b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.542785 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275b88c-3c99-4caa-82e4-34a2917449b5 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.543635 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275b88c-3c99-4caa-82e4-34a2917449b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:17.544875 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275b88c-3c99-4caa-82e4-34a2917449b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.545973 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275b88c-3c99-4caa-82e4-34a2917449b5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.562096 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4f21a-55f8-4974-803c-55e9882284a1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.567326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 424/824] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Jul 24 00:53:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:17.572292 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275b88c-3c99-4caa-82e4-34a2917449b5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:17.612830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0ed7d-bc91-47be-bd5e-9211757e74ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.614641 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0ed7d-bc91-47be-bd5e-9211757e74ac None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.615133 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0ed7d-bc91-47be-bd5e-9211757e74ac None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.615597 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0ed7d-bc91-47be-bd5e-9211757e74ac None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.616503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0ed7d-bc91-47be-bd5e-9211757e74ac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:17.616980 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0ed7d-bc91-47be-bd5e-9211757e74ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.618575 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0ed7d-bc91-47be-bd5e-9211757e74ac None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.626202 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 401/825] 10.222.0.43 () {56 vars in 1124 bytes} [Sun Jul 24 00:53:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:17.631941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0ed7d-bc91-47be-bd5e-9211757e74ac None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.690497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275b88c-3c99-4caa-82e4-34a2917449b5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.735752 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25244c41-f7c9-4633-8e9a-a8ae46273e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.736972 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244c41-f7c9-4633-8e9a-a8ae46273e37 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.737469 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244c41-f7c9-4633-8e9a-a8ae46273e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.737952 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244c41-f7c9-4633-8e9a-a8ae46273e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.738605 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0ed7d-bc91-47be-bd5e-9211757e74ac None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.776863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48283a97-571e-4356-bf58-10b518d02840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.778788 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48283a97-571e-4356-bf58-10b518d02840 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.779281 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48283a97-571e-4356-bf58-10b518d02840 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.779727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48283a97-571e-4356-bf58-10b518d02840 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.780662 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48283a97-571e-4356-bf58-10b518d02840 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.782241 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48283a97-571e-4356-bf58-10b518d02840 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.785736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:17.813404 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 402/826] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:17.825170 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25244c41-f7c9-4633-8e9a-a8ae46273e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.826760 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25244c41-f7c9-4633-8e9a-a8ae46273e37 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.940363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 425/827] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:17.946395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48283a97-571e-4356-bf58-10b518d02840 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.999532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:18.066360 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48283a97-571e-4356-bf58-10b518d02840 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.101926 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33969be6-1dbb-4ca0-8050-808391f68d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.102734 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33969be6-1dbb-4ca0-8050-808391f68d1b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.103009 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33969be6-1dbb-4ca0-8050-808391f68d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.103278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33969be6-1dbb-4ca0-8050-808391f68d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.114584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33969be6-1dbb-4ca0-8050-808391f68d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:18.116041 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33969be6-1dbb-4ca0-8050-808391f68d1b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-33969be6-1dbb-4ca0-8050-808391f68d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:18.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:18.134215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:18.135535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:18.135535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:18.135535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:18.135535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:18.135535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 403/828] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:18.140516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25244c41-f7c9-4633-8e9a-a8ae46273e37 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.203184 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf5937-e513-4f62-9a79-a1c3de7767ef None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.203503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf5937-e513-4f62-9a79-a1c3de7767ef None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.203729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf5937-e513-4f62-9a79-a1c3de7767ef None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.205260 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 404/829] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:18.210805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb398a6-d9bc-4b47-bd56-d3ea34ecc1ea None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.211097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb398a6-d9bc-4b47-bd56-d3ea34ecc1ea None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.211365 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb398a6-d9bc-4b47-bd56-d3ea34ecc1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.219736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:18.229413 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7cb398a6-d9bc-4b47-bd56-d3ea34ecc1ea None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:18.230648 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7cb398a6-d9bc-4b47-bd56-d3ea34ecc1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:18.256333 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25244c41-f7c9-4633-8e9a-a8ae46273e37 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.292566 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693e8da-12d1-421b-9e67-a027a0d7d43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.293710 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e8da-12d1-421b-9e67-a027a0d7d43b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.294415 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e8da-12d1-421b-9e67-a027a0d7d43b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.294912 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e8da-12d1-421b-9e67-a027a0d7d43b None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693e8da-12d1-421b-9e67-a027a0d7d43b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:18.296512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693e8da-12d1-421b-9e67-a027a0d7d43b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:18.298105 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693e8da-12d1-421b-9e67-a027a0d7d43b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:18.309601 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 405/830] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:18.311806 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 426/831] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:18.317462 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb398a6-d9bc-4b47-bd56-d3ea34ecc1ea None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.329091 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693e8da-12d1-421b-9e67-a027a0d7d43b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.342199 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:18.427061 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb398a6-d9bc-4b47-bd56-d3ea34ecc1ea None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.436264 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693e8da-12d1-421b-9e67-a027a0d7d43b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.462807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fe93a-8faf-4e98-9567-1adc0485ef32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.463616 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fe93a-8faf-4e98-9567-1adc0485ef32 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.463909 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fe93a-8faf-4e98-9567-1adc0485ef32 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.464189 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fe93a-8faf-4e98-9567-1adc0485ef32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.465563 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:18.471253 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fe93a-8faf-4e98-9567-1adc0485ef32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:18.472802 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fe93a-8faf-4e98-9567-1adc0485ef32 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:18.477790 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ed1d3-d468-46f5-8993-5d5e9d3b1c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.478820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ed1d3-d468-46f5-8993-5d5e9d3b1c35 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.479303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ed1d3-d468-46f5-8993-5d5e9d3b1c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.479862 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ed1d3-d468-46f5-8993-5d5e9d3b1c35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ca2fe93a-8faf-4e98-9567-1adc0485ef32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:18.487622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:18.488540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:18.489501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:18.489501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:18.489501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:18.489501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:18.489501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:18.489501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:18.489501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:18.489501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:18.493631 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 406/832] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:18.494493 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fe93a-8faf-4e98-9567-1adc0485ef32 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.495059 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ed1d3-d468-46f5-8993-5d5e9d3b1c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-9d9ed1d3-d468-46f5-8993-5d5e9d3b1c35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:18.503222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:18.504171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:18.505019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:18.505019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:18.505019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:18.505019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:18.505019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:18.505019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:18.505019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:18.505019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:18.505019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:18.505019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:18.505019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:18.505019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:18.512765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 427/833] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:18.513996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ed1d3-d468-46f5-8993-5d5e9d3b1c35 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.579284 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:18.605755 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fe93a-8faf-4e98-9567-1adc0485ef32 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.627605 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ed1d3-d468-46f5-8993-5d5e9d3b1c35 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.642935 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6e097-2a3e-4282-9cfd-43f186f2b352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.643856 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6e097-2a3e-4282-9cfd-43f186f2b352 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.643856 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6e097-2a3e-4282-9cfd-43f186f2b352 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.644151 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6e097-2a3e-4282-9cfd-43f186f2b352 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.644956 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6e097-2a3e-4282-9cfd-43f186f2b352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:18.645375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6e097-2a3e-4282-9cfd-43f186f2b352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:18.646767 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6e097-2a3e-4282-9cfd-43f186f2b352 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:18.665399 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 407/834] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:18.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6e097-2a3e-4282-9cfd-43f186f2b352 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.668825 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14964c0-d0bd-4aaf-b800-548e1919f93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.669976 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14964c0-d0bd-4aaf-b800-548e1919f93f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.670500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14964c0-d0bd-4aaf-b800-548e1919f93f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.670970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14964c0-d0bd-4aaf-b800-548e1919f93f None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.671924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14964c0-d0bd-4aaf-b800-548e1919f93f None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:18.672441 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14964c0-d0bd-4aaf-b800-548e1919f93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:18.674043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14964c0-d0bd-4aaf-b800-548e1919f93f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:18.683536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 428/835] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:18.689366 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14964c0-d0bd-4aaf-b800-548e1919f93f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.742586 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:18.778540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6e097-2a3e-4282-9cfd-43f186f2b352 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.806275 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14964c0-d0bd-4aaf-b800-548e1919f93f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.822492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6782c-ac90-466a-8ee0-de504cf18158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.823730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6782c-ac90-466a-8ee0-de504cf18158 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.824365 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6782c-ac90-466a-8ee0-de504cf18158 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.824736 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6782c-ac90-466a-8ee0-de504cf18158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.826000 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6782c-ac90-466a-8ee0-de504cf18158 None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=808b08d1d2df42e587279071a5dba593) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:18.826761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6782c-ac90-466a-8ee0-de504cf18158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:18.828308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6782c-ac90-466a-8ee0-de504cf18158 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:18.837428 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 408/836] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/role_assignments?user.id=808b08d1d2df42e587279071a5dba593&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:18.854582 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b6078-5580-4bb1-92a2-20a9594f7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b6078-5580-4bb1-92a2-20a9594f7c18 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.855715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b6078-5580-4bb1-92a2-20a9594f7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.855986 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b6078-5580-4bb1-92a2-20a9594f7c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.869795 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b6078-5580-4bb1-92a2-20a9594f7c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:18.872042 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b6078-5580-4bb1-92a2-20a9594f7c18 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-1d9b6078-5580-4bb1-92a2-20a9594f7c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:18.891939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:18.892916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:18.893850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:18.893850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:18.893850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:18.893850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:18.893850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 429/837] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:18.902453 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6782c-ac90-466a-8ee0-de504cf18158 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.906273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:19.025263 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6782c-ac90-466a-8ee0-de504cf18158 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.061139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17745454-9cdf-41b6-9e1c-25a1640e6f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.061853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17745454-9cdf-41b6-9e1c-25a1640e6f69 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.062139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17745454-9cdf-41b6-9e1c-25a1640e6f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.062417 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17745454-9cdf-41b6-9e1c-25a1640e6f69 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.063166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17745454-9cdf-41b6-9e1c-25a1640e6f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:19.063470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17745454-9cdf-41b6-9e1c-25a1640e6f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.064868 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17745454-9cdf-41b6-9e1c-25a1640e6f69 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.079121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 409/838] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:19.084796 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b6078-5580-4bb1-92a2-20a9594f7c18 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.187895 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:19.191554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b6078-5580-4bb1-92a2-20a9594f7c18 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.227695 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b067ff-b0bd-403b-a84f-4fb980295cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.228524 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b067ff-b0bd-403b-a84f-4fb980295cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.228803 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b067ff-b0bd-403b-a84f-4fb980295cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.229071 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b067ff-b0bd-403b-a84f-4fb980295cd9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.236558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b067ff-b0bd-403b-a84f-4fb980295cd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.238035 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b067ff-b0bd-403b-a84f-4fb980295cd9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-59b067ff-b0bd-403b-a84f-4fb980295cd9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:19.253259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:19.254242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:19.255183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:19.255183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:19.255183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:19.255183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:19.255183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:19.255183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:19.255183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:19.255183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:19.255183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:19.255183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:19.255183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 430/839] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:19.260538 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17745454-9cdf-41b6-9e1c-25a1640e6f69 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.326249 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:19.366443 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17745454-9cdf-41b6-9e1c-25a1640e6f69 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.401051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b6b92-953f-4145-999a-415990c630ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.401761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b6b92-953f-4145-999a-415990c630ea None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.402054 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b6b92-953f-4145-999a-415990c630ea None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.402331 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b6b92-953f-4145-999a-415990c630ea None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.403239 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b6b92-953f-4145-999a-415990c630ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:19.403555 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b6b92-953f-4145-999a-415990c630ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.404997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b6b92-953f-4145-999a-415990c630ea None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.423843 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 410/840] 10.222.0.43 () {56 vars in 1149 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:19.429244 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b067ff-b0bd-403b-a84f-4fb980295cd9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.538486 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b067ff-b0bd-403b-a84f-4fb980295cd9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.562324 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a3d1e-c84d-4c92-8e9e-1bd256426dc3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.562606 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a3d1e-c84d-4c92-8e9e-1bd256426dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.562887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a3d1e-c84d-4c92-8e9e-1bd256426dc3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.565317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 411/841] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:19.571932 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430579e6-5f9a-4f12-b2ea-cf68a682b20d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.571932 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430579e6-5f9a-4f12-b2ea-cf68a682b20d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.571932 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430579e6-5f9a-4f12-b2ea-cf68a682b20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.580048 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b48cc-91b3-4530-99c4-d46d3a731e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b48cc-91b3-4530-99c4-d46d3a731e38 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.581429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b48cc-91b3-4530-99c4-d46d3a731e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.581901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b48cc-91b3-4530-99c4-d46d3a731e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.593904 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-430579e6-5f9a-4f12-b2ea-cf68a682b20d None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:19.595350 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-430579e6-5f9a-4f12-b2ea-cf68a682b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:19.615057 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:19.659167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b48cc-91b3-4530-99c4-d46d3a731e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.661012 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b48cc-91b3-4530-99c4-d46d3a731e38 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.673340 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 412/842] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:19.695570 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430579e6-5f9a-4f12-b2ea-cf68a682b20d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:19.779978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 431/843] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:53:19.785724 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b48cc-91b3-4530-99c4-d46d3a731e38 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.835504 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430579e6-5f9a-4f12-b2ea-cf68a682b20d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.851144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:19.882901 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a02b35-96ed-4707-aa64-49efa7bb9095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.883721 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a02b35-96ed-4707-aa64-49efa7bb9095 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.884001 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a02b35-96ed-4707-aa64-49efa7bb9095 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.884272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a02b35-96ed-4707-aa64-49efa7bb9095 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.895824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b48cc-91b3-4530-99c4-d46d3a731e38 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.897417 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a02b35-96ed-4707-aa64-49efa7bb9095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-35a02b35-96ed-4707-aa64-49efa7bb9095 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:19.906898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:19.907882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:19.908715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:19.908715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:19.908715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:19.908715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:19.908715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:19.908715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:19.908715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:19.908715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:19.908715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:19.908715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:19.908715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:19.908715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:19.913485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 413/844] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:19.914616 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a02b35-96ed-4707-aa64-49efa7bb9095 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.940534 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d14906-8fd3-48eb-8af0-2e149ca0c9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.941423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d14906-8fd3-48eb-8af0-2e149ca0c9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.941707 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d14906-8fd3-48eb-8af0-2e149ca0c9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.941977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d14906-8fd3-48eb-8af0-2e149ca0c9a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.954067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d14906-8fd3-48eb-8af0-2e149ca0c9a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.955561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d14906-8fd3-48eb-8af0-2e149ca0c9a0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-23d14906-8fd3-48eb-8af0-2e149ca0c9a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:19.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:19.977531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:19.978455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:19.978455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:19.978455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:19.978455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:19.982957 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 432/845] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:19.983986 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d14906-8fd3-48eb-8af0-2e149ca0c9a0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.102535 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d14906-8fd3-48eb-8af0-2e149ca0c9a0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.120262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.145424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40854018-fcc4-41e5-b7c7-8dacbf169443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.146377 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40854018-fcc4-41e5-b7c7-8dacbf169443 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.146654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40854018-fcc4-41e5-b7c7-8dacbf169443 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.146929 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40854018-fcc4-41e5-b7c7-8dacbf169443 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.147646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40854018-fcc4-41e5-b7c7-8dacbf169443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:20.147947 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40854018-fcc4-41e5-b7c7-8dacbf169443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.149343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40854018-fcc4-41e5-b7c7-8dacbf169443 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.153013 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a02b35-96ed-4707-aa64-49efa7bb9095 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.160473 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 433/846] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:20.161829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5c91-10cc-4ddc-98d3-0e3454b7085c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.162107 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5c91-10cc-4ddc-98d3-0e3454b7085c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.162382 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5c91-10cc-4ddc-98d3-0e3454b7085c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.167501 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 434/847] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:20.167501 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf5c91-10cc-4ddc-98d3-0e3454b7085c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.171746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.197631 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e63682-0966-4e90-a680-815b318ff610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.198317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63682-0966-4e90-a680-815b318ff610 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.198640 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63682-0966-4e90-a680-815b318ff610 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.198877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63682-0966-4e90-a680-815b318ff610 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.199633 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e63682-0966-4e90-a680-815b318ff610 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:20.200026 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e63682-0966-4e90-a680-815b318ff610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.201465 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e63682-0966-4e90-a680-815b318ff610 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.214965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 414/848] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:20.214965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12639782-bb50-42f6-accc-0ed8ab3e64bf None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.214965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12639782-bb50-42f6-accc-0ed8ab3e64bf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.214965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12639782-bb50-42f6-accc-0ed8ab3e64bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.228719 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-12639782-bb50-42f6-accc-0ed8ab3e64bf None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:20.229949 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-12639782-bb50-42f6-accc-0ed8ab3e64bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:20.277038 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf5c91-10cc-4ddc-98d3-0e3454b7085c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.297178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 415/849] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:20.306192 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12639782-bb50-42f6-accc-0ed8ab3e64bf None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.318447 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c7e89-fcec-496a-80ca-e338420f32d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c7e89-fcec-496a-80ca-e338420f32d8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.319532 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c7e89-fcec-496a-80ca-e338420f32d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.319804 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c7e89-fcec-496a-80ca-e338420f32d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.327361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c7e89-fcec-496a-80ca-e338420f32d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.328808 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c7e89-fcec-496a-80ca-e338420f32d8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-6f4c7e89-fcec-496a-80ca-e338420f32d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:20.343320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:20.344198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:20.345826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:20.345826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:20.345826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:20.345826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:20.345826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:20.345826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:20.345826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:20.345826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:20.345826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 435/850] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:20.345826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c7e89-fcec-496a-80ca-e338420f32d8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.377893 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.422883 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12639782-bb50-42f6-accc-0ed8ab3e64bf None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.424513 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.453885 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c7e89-fcec-496a-80ca-e338420f32d8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.458397 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea925d-c54c-4e82-a84f-7d9f3b7ce33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.459573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea925d-c54c-4e82-a84f-7d9f3b7ce33d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.459854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea925d-c54c-4e82-a84f-7d9f3b7ce33d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.460126 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea925d-c54c-4e82-a84f-7d9f3b7ce33d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.471506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea925d-c54c-4e82-a84f-7d9f3b7ce33d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.472976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea925d-c54c-4e82-a84f-7d9f3b7ce33d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.489986 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fa1b4-929f-4a5c-90c3-63998820376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.490787 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fa1b4-929f-4a5c-90c3-63998820376f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9eea925d-c54c-4e82-a84f-7d9f3b7ce33d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:20.491012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:20.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:20.497839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:20.497839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:20.497839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:20.497839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:20.498068 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fa1b4-929f-4a5c-90c3-63998820376f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.498068 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fa1b4-929f-4a5c-90c3-63998820376f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.498068 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fa1b4-929f-4a5c-90c3-63998820376f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.498264 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 416/851] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:20.498264 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea925d-c54c-4e82-a84f-7d9f3b7ce33d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.498398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fa1b4-929f-4a5c-90c3-63998820376f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-094fa1b4-929f-4a5c-90c3-63998820376f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:20.513102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:20.514163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:20.515039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 436/852] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:20.516581 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fa1b4-929f-4a5c-90c3-63998820376f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.607166 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea925d-c54c-4e82-a84f-7d9f3b7ce33d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.621384 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.628115 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fa1b4-929f-4a5c-90c3-63998820376f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.641717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fea97-471d-4317-b008-fe87dc73da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.642469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fea97-471d-4317-b008-fe87dc73da28 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.642816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fea97-471d-4317-b008-fe87dc73da28 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.643154 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fea97-471d-4317-b008-fe87dc73da28 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.644011 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fea97-471d-4317-b008-fe87dc73da28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:20.644380 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fea97-471d-4317-b008-fe87dc73da28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.645896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fea97-471d-4317-b008-fe87dc73da28 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.658749 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 417/853] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:20.659616 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fea97-471d-4317-b008-fe87dc73da28 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.667926 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68724cb2-d4b9-48f6-b6fa-1a11ba76c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.668637 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724cb2-d4b9-48f6-b6fa-1a11ba76c49d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.668920 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724cb2-d4b9-48f6-b6fa-1a11ba76c49d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.669190 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724cb2-d4b9-48f6-b6fa-1a11ba76c49d None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.670065 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68724cb2-d4b9-48f6-b6fa-1a11ba76c49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:20.670258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68724cb2-d4b9-48f6-b6fa-1a11ba76c49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.671617 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68724cb2-d4b9-48f6-b6fa-1a11ba76c49d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.677536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.689125 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 437/854] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:20.689125 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68724cb2-d4b9-48f6-b6fa-1a11ba76c49d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.764801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fea97-471d-4317-b008-fe87dc73da28 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.793737 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68724cb2-d4b9-48f6-b6fa-1a11ba76c49d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.799829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa3377-8cae-46be-aa04-e184465855c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.800588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa3377-8cae-46be-aa04-e184465855c7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.800938 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa3377-8cae-46be-aa04-e184465855c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.801309 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa3377-8cae-46be-aa04-e184465855c7 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.802129 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa3377-8cae-46be-aa04-e184465855c7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:20.802500 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa3377-8cae-46be-aa04-e184465855c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.803950 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa3377-8cae-46be-aa04-e184465855c7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.813474 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 418/855] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:20.813474 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa3377-8cae-46be-aa04-e184465855c7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.836670 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5f5ac-21da-4901-a920-e017fccd186f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.837352 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5f5ac-21da-4901-a920-e017fccd186f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.837629 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5f5ac-21da-4901-a920-e017fccd186f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.837899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5f5ac-21da-4901-a920-e017fccd186f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.838839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5f5ac-21da-4901-a920-e017fccd186f None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=8a465bdbfe3248679adc15154a152d23) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:20.839266 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5f5ac-21da-4901-a920-e017fccd186f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.840744 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5f5ac-21da-4901-a920-e017fccd186f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.847041 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 438/856] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/role_assignments?user.id=8a465bdbfe3248679adc15154a152d23&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:20.847811 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5f5ac-21da-4901-a920-e017fccd186f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.872664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.918736 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.950711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa3377-8cae-46be-aa04-e184465855c7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.967741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5f5ac-21da-4901-a920-e017fccd186f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.989441 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681aaaa-c7d3-4914-acf5-dfa8e5bf359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.990250 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681aaaa-c7d3-4914-acf5-dfa8e5bf359d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.990532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681aaaa-c7d3-4914-acf5-dfa8e5bf359d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.990807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681aaaa-c7d3-4914-acf5-dfa8e5bf359d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.998919 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681aaaa-c7d3-4914-acf5-dfa8e5bf359d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.000387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681aaaa-c7d3-4914-acf5-dfa8e5bf359d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.005533 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864a5f9-5910-4efd-93c3-5dfcfb1d0aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.006485 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864a5f9-5910-4efd-93c3-5dfcfb1d0aff None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.006837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864a5f9-5910-4efd-93c3-5dfcfb1d0aff None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.007202 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864a5f9-5910-4efd-93c3-5dfcfb1d0aff None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.007985 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864a5f9-5910-4efd-93c3-5dfcfb1d0aff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:21.008352 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864a5f9-5910-4efd-93c3-5dfcfb1d0aff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.009846 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864a5f9-5910-4efd-93c3-5dfcfb1d0aff None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.015125 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 439/857] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-4681aaaa-c7d3-4914-acf5-dfa8e5bf359d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:21.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:21.016999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:21.018524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:21.018524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:21.018524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:21.018524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:21.018524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:21.018524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:21.018524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:21.018524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:21.018524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:21.018524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:21.019320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8ead6-7174-4546-bd41-72b8928a8c19 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.019320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8ead6-7174-4546-bd41-72b8928a8c19 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.019472 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 419/858] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:21.019552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8ead6-7174-4546-bd41-72b8928a8c19 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.019552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 440/859] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:21.022642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681aaaa-c7d3-4914-acf5-dfa8e5bf359d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.023860 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a57ff0-9528-413a-b7c4-ac23c10dcf53 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.024148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a57ff0-9528-413a-b7c4-ac23c10dcf53 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.024425 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a57ff0-9528-413a-b7c4-ac23c10dcf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.043077 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-28a57ff0-9528-413a-b7c4-ac23c10dcf53 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:21.044351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-28a57ff0-9528-413a-b7c4-ac23c10dcf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:21.136450 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 441/860] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:21.160857 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a57ff0-9528-413a-b7c4-ac23c10dcf53 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.180249 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681aaaa-c7d3-4914-acf5-dfa8e5bf359d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.189586 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:21.222692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9ed3e-7479-4918-ba88-fe543281d0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.223545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9ed3e-7479-4918-ba88-fe543281d0cb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.223919 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9ed3e-7479-4918-ba88-fe543281d0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.224287 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9ed3e-7479-4918-ba88-fe543281d0cb None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.225280 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9ed3e-7479-4918-ba88-fe543281d0cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:21.225689 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9ed3e-7479-4918-ba88-fe543281d0cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.227224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9ed3e-7479-4918-ba88-fe543281d0cb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.237445 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:21.248846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 420/861] 10.222.0.43 () {56 vars in 1135 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:21.254104 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9ed3e-7479-4918-ba88-fe543281d0cb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.286177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a57ff0-9528-413a-b7c4-ac23c10dcf53 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.334245 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec31f7-b99c-440a-8035-04763d4dd85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.335325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec31f7-b99c-440a-8035-04763d4dd85a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.335618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec31f7-b99c-440a-8035-04763d4dd85a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.335994 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec31f7-b99c-440a-8035-04763d4dd85a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec31f7-b99c-440a-8035-04763d4dd85a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.338307 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec31f7-b99c-440a-8035-04763d4dd85a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-1fec31f7-b99c-440a-8035-04763d4dd85a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:21.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:21.352261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:21.353321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:21.355386 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 442/862] 10.222.0.43 () {56 vars in 1132 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:21.361003 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec31f7-b99c-440a-8035-04763d4dd85a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.384631 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9ed3e-7479-4918-ba88-fe543281d0cb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.431869 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1497-024f-45e9-b4ff-a942f31ca583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.433599 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1497-024f-45e9-b4ff-a942f31ca583 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.435016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1497-024f-45e9-b4ff-a942f31ca583 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.435468 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1497-024f-45e9-b4ff-a942f31ca583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.443917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:21.468424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec31f7-b99c-440a-8035-04763d4dd85a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.505083 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ada95a-6a9a-4ab1-a6e6-cccafd7cafb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.505714 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ada95a-6a9a-4ab1-a6e6-cccafd7cafb2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.506063 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ada95a-6a9a-4ab1-a6e6-cccafd7cafb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.506404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ada95a-6a9a-4ab1-a6e6-cccafd7cafb2 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.507181 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ada95a-6a9a-4ab1-a6e6-cccafd7cafb2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:21.507550 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ada95a-6a9a-4ab1-a6e6-cccafd7cafb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.509082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ada95a-6a9a-4ab1-a6e6-cccafd7cafb2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.519303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 443/863] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:21.520406 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ada95a-6a9a-4ab1-a6e6-cccafd7cafb2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.521034 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:21.526136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be1497-024f-45e9-b4ff-a942f31ca583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.527917 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be1497-024f-45e9-b4ff-a942f31ca583 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.630554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ada95a-6a9a-4ab1-a6e6-cccafd7cafb2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.649012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 421/864] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:53:21.654824 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1497-024f-45e9-b4ff-a942f31ca583 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.665621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b012426-6689-4f79-aba7-fa3b9089fb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.666372 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b012426-6689-4f79-aba7-fa3b9089fb09 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.666722 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b012426-6689-4f79-aba7-fa3b9089fb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.667064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b012426-6689-4f79-aba7-fa3b9089fb09 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.667860 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b012426-6689-4f79-aba7-fa3b9089fb09 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:21.668243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b012426-6689-4f79-aba7-fa3b9089fb09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.669730 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b012426-6689-4f79-aba7-fa3b9089fb09 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.681731 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 444/865] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:21.773058 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:21.779779 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1497-024f-45e9-b4ff-a942f31ca583 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.817219 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb53b35-975e-4d9b-90d5-1e09c1698756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.818058 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb53b35-975e-4d9b-90d5-1e09c1698756 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.818338 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb53b35-975e-4d9b-90d5-1e09c1698756 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.818611 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb53b35-975e-4d9b-90d5-1e09c1698756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.830505 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb53b35-975e-4d9b-90d5-1e09c1698756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.832067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb53b35-975e-4d9b-90d5-1e09c1698756 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-1fb53b35-975e-4d9b-90d5-1e09c1698756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:21.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:21.852353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:21.853687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:21.853687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:21.853687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:21.853687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:21.853687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 422/866] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:21.858201 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b012426-6689-4f79-aba7-fa3b9089fb09 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.868608 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:21.970688 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b012426-6689-4f79-aba7-fa3b9089fb09 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:22.005499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a50471-a307-4401-93ec-01bce6fb1c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:22.006178 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a50471-a307-4401-93ec-01bce6fb1c5f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:22.006462 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a50471-a307-4401-93ec-01bce6fb1c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:22.006737 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a50471-a307-4401-93ec-01bce6fb1c5f None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:22.007465 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a50471-a307-4401-93ec-01bce6fb1c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:22.007778 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a50471-a307-4401-93ec-01bce6fb1c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:22.009246 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a50471-a307-4401-93ec-01bce6fb1c5f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:22.021786 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 445/867] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:22.027636 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb53b35-975e-4d9b-90d5-1e09c1698756 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:22.129603 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb53b35-975e-4d9b-90d5-1e09c1698756 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:22.165277 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390e449-a166-4b35-95c7-c26a8f0f2c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:22.166093 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390e449-a166-4b35-95c7-c26a8f0f2c07 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:22.166368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390e449-a166-4b35-95c7-c26a8f0f2c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:22.166637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390e449-a166-4b35-95c7-c26a8f0f2c07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:22.173507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390e449-a166-4b35-95c7-c26a8f0f2c07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:22.174953 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390e449-a166-4b35-95c7-c26a8f0f2c07 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-3390e449-a166-4b35-95c7-c26a8f0f2c07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:22.188861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:22.189858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:22.190750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:22.190750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:22.190750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:22.190750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:22.190750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:22.190750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:22.190750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:22.190750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:22.190750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 423/868] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:22.196479 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a50471-a307-4401-93ec-01bce6fb1c5f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:22.267517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:22.303584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a50471-a307-4401-93ec-01bce6fb1c5f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:22.338180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f4cec-0186-4ba1-89db-c5092925fb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:22.338866 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f4cec-0186-4ba1-89db-c5092925fb83 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:22.339150 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f4cec-0186-4ba1-89db-c5092925fb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:22.339426 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f4cec-0186-4ba1-89db-c5092925fb83 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:22.340265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f4cec-0186-4ba1-89db-c5092925fb83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:22.340583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f4cec-0186-4ba1-89db-c5092925fb83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:22.342047 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f4cec-0186-4ba1-89db-c5092925fb83 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:22.354461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 446/869] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:22.360502 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390e449-a166-4b35-95c7-c26a8f0f2c07 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:22.378272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:22.464602 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390e449-a166-4b35-95c7-c26a8f0f2c07 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:22.498099 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01078a24-975e-4d00-bfb5-e19b8d6ab81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:22.498770 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01078a24-975e-4d00-bfb5-e19b8d6ab81f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:22.499054 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01078a24-975e-4d00-bfb5-e19b8d6ab81f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:22.499331 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01078a24-975e-4d00-bfb5-e19b8d6ab81f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:22.500174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01078a24-975e-4d00-bfb5-e19b8d6ab81f None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=bd9e9ad3ecec40b9a3c88a5f2b8fdfe2) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:22.500487 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01078a24-975e-4d00-bfb5-e19b8d6ab81f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:22.501951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01078a24-975e-4d00-bfb5-e19b8d6ab81f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:22.508186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 424/870] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:22 2022] GET /identity/v3/role_assignments?user.id=bd9e9ad3ecec40b9a3c88a5f2b8fdfe2&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:23.060436 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c2ecf-2f94-42a5-a30d-bc8e3724a465 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.060841 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c2ecf-2f94-42a5-a30d-bc8e3724a465 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.061021 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c2ecf-2f94-42a5-a30d-bc8e3724a465 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.062681 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 447/871] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:23.067906 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef27d-6234-4e5a-a8f0-e05c4b3d585c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.068197 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef27d-6234-4e5a-a8f0-e05c4b3d585c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.068474 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef27d-6234-4e5a-a8f0-e05c4b3d585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.085495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-940ef27d-6234-4e5a-a8f0-e05c4b3d585c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:23.086670 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-940ef27d-6234-4e5a-a8f0-e05c4b3d585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:23.155463 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 425/872] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:23.170210 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c18ef-8126-461f-ae51-34b14c7198ad None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.170517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c18ef-8126-461f-ae51-34b14c7198ad None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.170767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c18ef-8126-461f-ae51-34b14c7198ad None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.172468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 448/873] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:23.174815 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ef27d-6234-4e5a-a8f0-e05c4b3d585c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:23.177132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:23.177592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6013213-126d-40e0-a885-c525a8d1db68 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.177880 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6013213-126d-40e0-a885-c525a8d1db68 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.178155 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6013213-126d-40e0-a885-c525a8d1db68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.202151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d6013213-126d-40e0-a885-c525a8d1db68 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:23.203649 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d6013213-126d-40e0-a885-c525a8d1db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:23.284179 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ef27d-6234-4e5a-a8f0-e05c4b3d585c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:23.301314 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 449/874] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:23.326232 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6013213-126d-40e0-a885-c525a8d1db68 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:23.335230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dcc11-b1fe-4c70-b15c-76105164c7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:23.336398 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dcc11-b1fe-4c70-b15c-76105164c7fb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.336849 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dcc11-b1fe-4c70-b15c-76105164c7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.337325 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dcc11-b1fe-4c70-b15c-76105164c7fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.349761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137dcc11-b1fe-4c70-b15c-76105164c7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-137dcc11-b1fe-4c70-b15c-76105164c7fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:23.358778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:23.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:23.365838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 426/875] 10.222.0.43 () {56 vars in 1120 bytes} [Sun Jul 24 00:53:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:23.367979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dcc11-b1fe-4c70-b15c-76105164c7fb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:23.390126 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:23.435375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:23.439823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6013213-126d-40e0-a885-c525a8d1db68 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:23.475199 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dcc11-b1fe-4c70-b15c-76105164c7fb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:23.476760 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2cfe3-29f2-42e3-ad5a-4def38ff66ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:23.477634 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2cfe3-29f2-42e3-ad5a-4def38ff66ce None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.477991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2cfe3-29f2-42e3-ad5a-4def38ff66ce None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.478337 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2cfe3-29f2-42e3-ad5a-4def38ff66ce None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.479595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2cfe3-29f2-42e3-ad5a-4def38ff66ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:23.480699 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2cfe3-29f2-42e3-ad5a-4def38ff66ce None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:23.501631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 450/876] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:23 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:53:23.521684 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53dce6-f57f-410b-a3ba-7219d31f75ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:23.523006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53dce6-f57f-410b-a3ba-7219d31f75ff None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.523493 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53dce6-f57f-410b-a3ba-7219d31f75ff None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.523980 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53dce6-f57f-410b-a3ba-7219d31f75ff None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.524962 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53dce6-f57f-410b-a3ba-7219d31f75ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:23.525479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53dce6-f57f-410b-a3ba-7219d31f75ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:23.527163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53dce6-f57f-410b-a3ba-7219d31f75ff None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:23.542305 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 427/877] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Jul 24 00:53:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:23.544285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2cfe3-29f2-42e3-ad5a-4def38ff66ce None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:23.657525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2cfe3-29f2-42e3-ad5a-4def38ff66ce None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:23.681595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:23.704042 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb469902-1ebc-4d39-9e04-4c574b626876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:23.704869 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469902-1ebc-4d39-9e04-4c574b626876 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.705400 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469902-1ebc-4d39-9e04-4c574b626876 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.705679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469902-1ebc-4d39-9e04-4c574b626876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.719179 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb469902-1ebc-4d39-9e04-4c574b626876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:23.720792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb469902-1ebc-4d39-9e04-4c574b626876 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-bb469902-1ebc-4d39-9e04-4c574b626876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:23.740321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:23.741331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:23.742253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:23.742253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:23.742253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:23.742253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:23.742253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 451/878] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:23.747535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53dce6-f57f-410b-a3ba-7219d31f75ff None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:23.812346 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a8c2b-0535-4a4f-b61e-5169abaa2ad1 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.812628 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a8c2b-0535-4a4f-b61e-5169abaa2ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.812903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a8c2b-0535-4a4f-b61e-5169abaa2ad1 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.814610 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 452/879] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:23.821012 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bacb4-1c2f-4b14-b40d-6ab93aba7eaf None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.821521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bacb4-1c2f-4b14-b40d-6ab93aba7eaf None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.821978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bacb4-1c2f-4b14-b40d-6ab93aba7eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.842503 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-f08bacb4-1c2f-4b14-b40d-6ab93aba7eaf None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:23.844240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f08bacb4-1c2f-4b14-b40d-6ab93aba7eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:23.853806 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53dce6-f57f-410b-a3ba-7219d31f75ff None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:23.876740 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:23.892784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b51dab-37ab-4fc5-93d9-70116776905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:23.893714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b51dab-37ab-4fc5-93d9-70116776905d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.894160 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b51dab-37ab-4fc5-93d9-70116776905d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.894571 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b51dab-37ab-4fc5-93d9-70116776905d None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.895452 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b51dab-37ab-4fc5-93d9-70116776905d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:23.895896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b51dab-37ab-4fc5-93d9-70116776905d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:23.897530 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b51dab-37ab-4fc5-93d9-70116776905d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:23.910843 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 428/880] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:23.916610 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b51dab-37ab-4fc5-93d9-70116776905d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:23.928214 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 453/881] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:23.950726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bacb4-1c2f-4b14-b40d-6ab93aba7eaf None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.045229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b51dab-37ab-4fc5-93d9-70116776905d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.084432 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bacb4-1c2f-4b14-b40d-6ab93aba7eaf None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.084864 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcf454-2bed-4eaf-8588-804a75dabc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.085732 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcf454-2bed-4eaf-8588-804a75dabc45 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.086174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcf454-2bed-4eaf-8588-804a75dabc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.086309 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:24.086451 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcf454-2bed-4eaf-8588-804a75dabc45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.096346 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcf454-2bed-4eaf-8588-804a75dabc45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.098327 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcf454-2bed-4eaf-8588-804a75dabc45 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-bcdcf454-2bed-4eaf-8588-804a75dabc45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:24.117829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:24.118850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:24.124985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:24.124985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:24.124985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:24.124985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:24.124985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:24.124985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:24.124985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:24.124985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:24.124985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:24.124985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:24.124985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 429/882] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Jul 24 00:53:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:24.125653 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcf454-2bed-4eaf-8588-804a75dabc45 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.128566 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43a8fe-ce08-42c0-b25c-e4e2d67cfadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.129570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43a8fe-ce08-42c0-b25c-e4e2d67cfadf None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43a8fe-ce08-42c0-b25c-e4e2d67cfadf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.130132 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43a8fe-ce08-42c0-b25c-e4e2d67cfadf None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.131885 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43a8fe-ce08-42c0-b25c-e4e2d67cfadf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.133310 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43a8fe-ce08-42c0-b25c-e4e2d67cfadf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.153606 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 454/883] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:23 2022] POST /identity/v3/services => generated 269 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:24.176649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:24.245598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcf454-2bed-4eaf-8588-804a75dabc45 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.290238 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e4c8d-aaaa-4ba8-8da3-56f6ff55b4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.291187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e4c8d-aaaa-4ba8-8da3-56f6ff55b4bb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.291642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e4c8d-aaaa-4ba8-8da3-56f6ff55b4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.292071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e4c8d-aaaa-4ba8-8da3-56f6ff55b4bb None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.293140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e4c8d-aaaa-4ba8-8da3-56f6ff55b4bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:24.293636 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e4c8d-aaaa-4ba8-8da3-56f6ff55b4bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.295226 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e4c8d-aaaa-4ba8-8da3-56f6ff55b4bb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.320634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 430/884] 10.222.0.43 () {56 vars in 1149 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:24.323573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43a8fe-ce08-42c0-b25c-e4e2d67cfadf None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.430730 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43a8fe-ce08-42c0-b25c-e4e2d67cfadf None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.466069 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5081a-3ae9-4c5d-8cfe-b80f99c24f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.466733 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5081a-3ae9-4c5d-8cfe-b80f99c24f85 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.467018 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5081a-3ae9-4c5d-8cfe-b80f99c24f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.467292 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5081a-3ae9-4c5d-8cfe-b80f99c24f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:24.536448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5081a-3ae9-4c5d-8cfe-b80f99c24f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.538018 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5081a-3ae9-4c5d-8cfe-b80f99c24f85 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.649405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 455/885] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:24.655232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e4c8d-aaaa-4ba8-8da3-56f6ff55b4bb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.665970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf56b38-cb26-4488-8c6d-741f1090aa2e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.666143 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf56b38-cb26-4488-8c6d-741f1090aa2e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.666341 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf56b38-cb26-4488-8c6d-741f1090aa2e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.667920 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 456/886] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:24.672928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79797b-a440-498c-97a7-8964a41a73ad None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.673231 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79797b-a440-498c-97a7-8964a41a73ad None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.673525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79797b-a440-498c-97a7-8964a41a73ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.690893 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-1d79797b-a440-498c-97a7-8964a41a73ad None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:24.692039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1d79797b-a440-498c-97a7-8964a41a73ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:24.753398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:24.778774 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 457/887] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:24.789916 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e4c8d-aaaa-4ba8-8da3-56f6ff55b4bb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.793474 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:24.794517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79797b-a440-498c-97a7-8964a41a73ad None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.841175 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc1443-0ac4-4518-9e8d-ff00610e056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.842383 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc1443-0ac4-4518-9e8d-ff00610e056b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.843290 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc1443-0ac4-4518-9e8d-ff00610e056b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.843761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc1443-0ac4-4518-9e8d-ff00610e056b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.857389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc1443-0ac4-4518-9e8d-ff00610e056b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.859756 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc1443-0ac4-4518-9e8d-ff00610e056b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f9bc1443-0ac4-4518-9e8d-ff00610e056b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:24.882759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:24.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:24.884605 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:24.884605 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:24.884605 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:24.884605 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:24.887180 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 431/888] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:24.893784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc1443-0ac4-4518-9e8d-ff00610e056b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.915189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79797b-a440-498c-97a7-8964a41a73ad None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.957014 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6f543-cdd0-487e-bcfd-bceb33fbb054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.957859 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6f543-cdd0-487e-bcfd-bceb33fbb054 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.958231 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6f543-cdd0-487e-bcfd-bceb33fbb054 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.958938 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6f543-cdd0-487e-bcfd-bceb33fbb054 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.959666 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6f543-cdd0-487e-bcfd-bceb33fbb054 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.961871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6f543-cdd0-487e-bcfd-bceb33fbb054 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-9af6f543-cdd0-487e-bcfd-bceb33fbb054 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:24.978363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:24.979368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:24.980203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 458/889] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:24.987420 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6f543-cdd0-487e-bcfd-bceb33fbb054 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.012181 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc1443-0ac4-4518-9e8d-ff00610e056b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.043650 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:25.046251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8380597-1090-4054-b045-d159a42ca1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.047222 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8380597-1090-4054-b045-d159a42ca1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.047506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8380597-1090-4054-b045-d159a42ca1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.047777 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8380597-1090-4054-b045-d159a42ca1e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.048585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8380597-1090-4054-b045-d159a42ca1e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:25.048943 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8380597-1090-4054-b045-d159a42ca1e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.050404 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8380597-1090-4054-b045-d159a42ca1e5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.066878 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 432/890] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:25.068191 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8380597-1090-4054-b045-d159a42ca1e5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.077338 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:25.099484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6f543-cdd0-487e-bcfd-bceb33fbb054 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.135541 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd88337-96e6-4222-8129-3bf96cba79fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.136602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd88337-96e6-4222-8129-3bf96cba79fd None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.137147 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd88337-96e6-4222-8129-3bf96cba79fd None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.137638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd88337-96e6-4222-8129-3bf96cba79fd None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.138556 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd88337-96e6-4222-8129-3bf96cba79fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:25.139056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd88337-96e6-4222-8129-3bf96cba79fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.140802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd88337-96e6-4222-8129-3bf96cba79fd None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.149548 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 459/891] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:25.152241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd88337-96e6-4222-8129-3bf96cba79fd None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.171992 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8380597-1090-4054-b045-d159a42ca1e5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.207316 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fca044-36fa-440a-8f7d-80dcb728bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.208087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca044-36fa-440a-8f7d-80dcb728bc09 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.208740 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca044-36fa-440a-8f7d-80dcb728bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.209012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca044-36fa-440a-8f7d-80dcb728bc09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.216340 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fca044-36fa-440a-8f7d-80dcb728bc09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.217957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fca044-36fa-440a-8f7d-80dcb728bc09 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-e8fca044-36fa-440a-8f7d-80dcb728bc09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:25.232495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:25.233449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:25.234332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:25.234332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:25.234332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:25.234332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:25.234332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:25.234332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:25.234332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:25.234332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:25.239390 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 433/892] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:25.240201 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fca044-36fa-440a-8f7d-80dcb728bc09 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.263994 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd88337-96e6-4222-8129-3bf96cba79fd None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.282748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:25.304235 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93888f5f-52ff-484a-b583-3b867003e62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.305404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93888f5f-52ff-484a-b583-3b867003e62b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.305881 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93888f5f-52ff-484a-b583-3b867003e62b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.306345 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93888f5f-52ff-484a-b583-3b867003e62b None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.307238 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93888f5f-52ff-484a-b583-3b867003e62b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:25.307758 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93888f5f-52ff-484a-b583-3b867003e62b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.308216 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:25.310798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93888f5f-52ff-484a-b583-3b867003e62b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.320462 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 460/893] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:25.352911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fca044-36fa-440a-8f7d-80dcb728bc09 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.392438 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc122b5-0478-4b0a-8fbd-a44ad0b1a472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.393133 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc122b5-0478-4b0a-8fbd-a44ad0b1a472 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.393441 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc122b5-0478-4b0a-8fbd-a44ad0b1a472 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.393715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc122b5-0478-4b0a-8fbd-a44ad0b1a472 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.394528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc122b5-0478-4b0a-8fbd-a44ad0b1a472 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:25.394837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc122b5-0478-4b0a-8fbd-a44ad0b1a472 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.396390 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc122b5-0478-4b0a-8fbd-a44ad0b1a472 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.415380 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 434/894] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:25.417271 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93888f5f-52ff-484a-b583-3b867003e62b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.525681 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93888f5f-52ff-484a-b583-3b867003e62b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.560143 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddca14-ffa9-4329-b785-5f1a4555f9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.560813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddca14-ffa9-4329-b785-5f1a4555f9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.561097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddca14-ffa9-4329-b785-5f1a4555f9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.561410 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddca14-ffa9-4329-b785-5f1a4555f9f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.562249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddca14-ffa9-4329-b785-5f1a4555f9f1 None admin] RBAC: Adding query filter params (role.id=bf43109eef0844758450a191d35cf485, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=8a465bdbfe3248679adc15154a152d23) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:25.562561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddca14-ffa9-4329-b785-5f1a4555f9f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.564007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddca14-ffa9-4329-b785-5f1a4555f9f1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.573321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 461/895] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/role_assignments?user.id=8a465bdbfe3248679adc15154a152d23&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=bf43109eef0844758450a191d35cf485 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:25.653941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a5195-5b96-4bb1-87ad-6bbe3dbd5a02 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.654300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a5195-5b96-4bb1-87ad-6bbe3dbd5a02 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.654501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a5195-5b96-4bb1-87ad-6bbe3dbd5a02 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.656285 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 435/896] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:25.662107 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6378b09-4889-46ac-8342-e2d95d14baad None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.662404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6378b09-4889-46ac-8342-e2d95d14baad None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.662671 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6378b09-4889-46ac-8342-e2d95d14baad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.681237 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a6378b09-4889-46ac-8342-e2d95d14baad None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:25.682810 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a6378b09-4889-46ac-8342-e2d95d14baad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:25.734459 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:25.764733 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 462/897] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:25.786949 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a5195-5b96-4bb1-87ad-6bbe3dbd5a02 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.893005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a5195-5b96-4bb1-87ad-6bbe3dbd5a02 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.922906 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:25.931464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80696050-c8b5-44fd-bd33-fa6c0788733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.932289 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80696050-c8b5-44fd-bd33-fa6c0788733e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.932946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80696050-c8b5-44fd-bd33-fa6c0788733e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.933248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80696050-c8b5-44fd-bd33-fa6c0788733e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.933982 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80696050-c8b5-44fd-bd33-fa6c0788733e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.935621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80696050-c8b5-44fd-bd33-fa6c0788733e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-80696050-c8b5-44fd-bd33-fa6c0788733e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:25.948695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:25.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:25.950592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 436/898] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:25.956566 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6378b09-4889-46ac-8342-e2d95d14baad None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:26.063889 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6378b09-4889-46ac-8342-e2d95d14baad None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.099617 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907236fb-f989-4c59-9d07-5d8a10d5e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.100298 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907236fb-f989-4c59-9d07-5d8a10d5e100 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.100580 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907236fb-f989-4c59-9d07-5d8a10d5e100 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.100855 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907236fb-f989-4c59-9d07-5d8a10d5e100 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.101591 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907236fb-f989-4c59-9d07-5d8a10d5e100 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:26.101897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907236fb-f989-4c59-9d07-5d8a10d5e100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.103270 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907236fb-f989-4c59-9d07-5d8a10d5e100 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.112900 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 463/899] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:26.114299 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80696050-c8b5-44fd-bd33-fa6c0788733e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:26.220354 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80696050-c8b5-44fd-bd33-fa6c0788733e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.254506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc678b0c-f0f2-4498-8448-9d3c52b13bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.255577 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc678b0c-f0f2-4498-8448-9d3c52b13bba None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.256033 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc678b0c-f0f2-4498-8448-9d3c52b13bba None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.256506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc678b0c-f0f2-4498-8448-9d3c52b13bba None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.257409 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc678b0c-f0f2-4498-8448-9d3c52b13bba None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:26.257902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc678b0c-f0f2-4498-8448-9d3c52b13bba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.259519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc678b0c-f0f2-4498-8448-9d3c52b13bba None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.269318 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 437/900] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:26.271241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907236fb-f989-4c59-9d07-5d8a10d5e100 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:26.273687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe771ed9-ca08-4b08-8917-b221d67fb52d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.273978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe771ed9-ca08-4b08-8917-b221d67fb52d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.274540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe771ed9-ca08-4b08-8917-b221d67fb52d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.275616 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 438/901] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:26.281091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff254b74-936d-4692-a1d7-6e901d00d4cd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.281434 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff254b74-936d-4692-a1d7-6e901d00d4cd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.281718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff254b74-936d-4692-a1d7-6e901d00d4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.298822 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ff254b74-936d-4692-a1d7-6e901d00d4cd None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:26.300025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ff254b74-936d-4692-a1d7-6e901d00d4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:26.341715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:26.349713 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:26.373560 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 439/902] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:26.391425 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907236fb-f989-4c59-9d07-5d8a10d5e100 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.391629 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff254b74-936d-4692-a1d7-6e901d00d4cd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:26.433357 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d9095-701a-44a5-a170-0026de3c41f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.434691 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d9095-701a-44a5-a170-0026de3c41f4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.435434 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d9095-701a-44a5-a170-0026de3c41f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.435907 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d9095-701a-44a5-a170-0026de3c41f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.437097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d9095-701a-44a5-a170-0026de3c41f4 None admin] RBAC: Adding query filter params (interface=public, service_id=2d70c021fe6449b9b259dcf2dcaf348a, region_id=RegionOne) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:26.438008 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d9095-701a-44a5-a170-0026de3c41f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.439796 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d9095-701a-44a5-a170-0026de3c41f4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.446686 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 464/903] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:26 2022] GET /identity/v3/endpoints?service_id=2d70c021fe6449b9b259dcf2dcaf348a&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:26.451982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d9095-701a-44a5-a170-0026de3c41f4 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:26.506023 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff254b74-936d-4692-a1d7-6e901d00d4cd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.550522 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941f194-1713-4703-8b18-e8adfda0b631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.551933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941f194-1713-4703-8b18-e8adfda0b631 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.552373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d9095-701a-44a5-a170-0026de3c41f4 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.552916 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941f194-1713-4703-8b18-e8adfda0b631 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.553383 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941f194-1713-4703-8b18-e8adfda0b631 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.554379 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941f194-1713-4703-8b18-e8adfda0b631 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.556809 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941f194-1713-4703-8b18-e8adfda0b631 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-3941f194-1713-4703-8b18-e8adfda0b631 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:26.571334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:26.572308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:26.573158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:26.576523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 440/904] 10.222.0.43 () {56 vars in 1132 bytes} [Sun Jul 24 00:53:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:26.577602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:26.586134 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941f194-1713-4703-8b18-e8adfda0b631 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:26.603619 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e9e54-9bd7-491e-8c99-8edfb36da83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.604591 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e9e54-9bd7-491e-8c99-8edfb36da83d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.605172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e9e54-9bd7-491e-8c99-8edfb36da83d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.605720 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e9e54-9bd7-491e-8c99-8edfb36da83d None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.606655 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e9e54-9bd7-491e-8c99-8edfb36da83d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.608356 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e9e54-9bd7-491e-8c99-8edfb36da83d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.621735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 465/905] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:26 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 00:53:26.642310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:26.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941f194-1713-4703-8b18-e8adfda0b631 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.742809 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5522c0-f146-4f12-90a1-8118cbe827cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.743971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5522c0-f146-4f12-90a1-8118cbe827cc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.744467 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5522c0-f146-4f12-90a1-8118cbe827cc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.744948 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5522c0-f146-4f12-90a1-8118cbe827cc None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.746145 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5522c0-f146-4f12-90a1-8118cbe827cc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:26.746710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5522c0-f146-4f12-90a1-8118cbe827cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.748408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5522c0-f146-4f12-90a1-8118cbe827cc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.755117 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 441/906] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:26.761690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e9e54-9bd7-491e-8c99-8edfb36da83d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:26.873513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e9e54-9bd7-491e-8c99-8edfb36da83d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.907482 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49661b1a-13e6-4e40-8981-8bcab859a40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.908160 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661b1a-13e6-4e40-8981-8bcab859a40b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.908441 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661b1a-13e6-4e40-8981-8bcab859a40b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.908712 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661b1a-13e6-4e40-8981-8bcab859a40b None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.909445 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49661b1a-13e6-4e40-8981-8bcab859a40b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:26.909748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49661b1a-13e6-4e40-8981-8bcab859a40b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.911126 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49661b1a-13e6-4e40-8981-8bcab859a40b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.916335 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 466/907] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:26.922389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5522c0-f146-4f12-90a1-8118cbe827cc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:27.028523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5522c0-f146-4f12-90a1-8118cbe827cc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:27.042589 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:27.065876 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd9240-d737-4889-a48b-e350b2b32e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:27.066931 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd9240-d737-4889-a48b-e350b2b32e24 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.067432 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd9240-d737-4889-a48b-e350b2b32e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.067933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd9240-d737-4889-a48b-e350b2b32e24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.068930 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd9240-d737-4889-a48b-e350b2b32e24 None admin] RBAC: Adding query filter params (interface=public, service_id=cf0333ac032f44719728a3c34bde63bd, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:27.069501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd9240-d737-4889-a48b-e350b2b32e24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:27.071095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd9240-d737-4889-a48b-e350b2b32e24 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:27.079575 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 442/908] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:26 2022] GET /identity/v3/endpoints?service_id=cf0333ac032f44719728a3c34bde63bd&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:27.086325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49661b1a-13e6-4e40-8981-8bcab859a40b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:27.128656 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:27.201476 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49661b1a-13e6-4e40-8981-8bcab859a40b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:27.236373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024a7d3-bd11-4dcb-9227-bba63179b7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:27.237105 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024a7d3-bd11-4dcb-9227-bba63179b7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.237451 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024a7d3-bd11-4dcb-9227-bba63179b7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.237723 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024a7d3-bd11-4dcb-9227-bba63179b7c7 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.238410 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024a7d3-bd11-4dcb-9227-bba63179b7c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:27.239781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024a7d3-bd11-4dcb-9227-bba63179b7c7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:27.246034 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 467/909] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:27 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 00:53:27.441730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd0d53-c993-40c8-a249-5d729e2665fb None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.442222 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd0d53-c993-40c8-a249-5d729e2665fb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.442721 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd0d53-c993-40c8-a249-5d729e2665fb None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.444636 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 443/910] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:27.450246 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18441e1-1512-4cb6-8726-1f75c9486728 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.450775 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18441e1-1512-4cb6-8726-1f75c9486728 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.451259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18441e1-1512-4cb6-8726-1f75c9486728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.469236 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a18441e1-1512-4cb6-8726-1f75c9486728 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:27.470746 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a18441e1-1512-4cb6-8726-1f75c9486728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:27.543862 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 468/911] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:27.566370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd0d53-c993-40c8-a249-5d729e2665fb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:27.674497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d500343-fe7d-4a52-ad93-07524b449266 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.675023 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d500343-fe7d-4a52-ad93-07524b449266 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.675023 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d500343-fe7d-4a52-ad93-07524b449266 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.676590 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 469/912] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:27.680582 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd0d53-c993-40c8-a249-5d729e2665fb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:27.681982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dac20b-9c09-4609-928e-1261d20af7fc None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.682518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dac20b-9c09-4609-928e-1261d20af7fc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.682999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dac20b-9c09-4609-928e-1261d20af7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.700184 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c9dac20b-9c09-4609-928e-1261d20af7fc None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:27.701874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c9dac20b-9c09-4609-928e-1261d20af7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:27.715924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddcd60-3eb1-44eb-b522-202fa056c59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:27.716607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddcd60-3eb1-44eb-b522-202fa056c59a None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.716894 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddcd60-3eb1-44eb-b522-202fa056c59a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.717170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddcd60-3eb1-44eb-b522-202fa056c59a None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.717959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddcd60-3eb1-44eb-b522-202fa056c59a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:27.719598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddcd60-3eb1-44eb-b522-202fa056c59a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:27.723274 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:27.739465 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 444/913] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:27 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:27.798427 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 470/914] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:27.821246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddcd60-3eb1-44eb-b522-202fa056c59a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:27.865621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:27.939681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddcd60-3eb1-44eb-b522-202fa056c59a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:27.975569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84d715-85d7-4974-a22c-71bb08ef497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:27.976790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84d715-85d7-4974-a22c-71bb08ef497f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.977301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84d715-85d7-4974-a22c-71bb08ef497f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.977765 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84d715-85d7-4974-a22c-71bb08ef497f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.988749 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84d715-85d7-4974-a22c-71bb08ef497f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-bb84d715-85d7-4974-a22c-71bb08ef497f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:27.997349 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:27.998286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:27.999146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:27.999146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:27.999146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:27.999146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:27.999146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:27.999146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:27.999146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:27.999146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:27.999146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:27.999146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:27.999146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:27.999146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:28.005312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 445/915] 10.222.0.43 () {56 vars in 1120 bytes} [Sun Jul 24 00:53:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:28.008212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dac20b-9c09-4609-928e-1261d20af7fc None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:28.108161 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dac20b-9c09-4609-928e-1261d20af7fc None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:28.142404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745c8c4-3ace-4c38-9ba9-f2e698d04341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:28.143550 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745c8c4-3ace-4c38-9ba9-f2e698d04341 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:28.144031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745c8c4-3ace-4c38-9ba9-f2e698d04341 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:28.144816 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745c8c4-3ace-4c38-9ba9-f2e698d04341 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:28.145786 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745c8c4-3ace-4c38-9ba9-f2e698d04341 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:28.146297 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745c8c4-3ace-4c38-9ba9-f2e698d04341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:28.147860 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745c8c4-3ace-4c38-9ba9-f2e698d04341 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:28.160280 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 471/916] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Jul 24 00:53:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:28.165893 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84d715-85d7-4974-a22c-71bb08ef497f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:28.263394 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:28.270676 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84d715-85d7-4974-a22c-71bb08ef497f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:28.306947 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89220dca-639e-4619-88e1-58606f259627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:28.307757 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89220dca-639e-4619-88e1-58606f259627 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:28.308038 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89220dca-639e-4619-88e1-58606f259627 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:28.308331 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89220dca-639e-4619-88e1-58606f259627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:28.319373 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89220dca-639e-4619-88e1-58606f259627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:28.320822 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89220dca-639e-4619-88e1-58606f259627 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-89220dca-639e-4619-88e1-58606f259627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:28.338229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:28.339136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:28.340503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:28.340503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:28.340503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:28.340503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:28.340503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 446/917] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:28.347138 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745c8c4-3ace-4c38-9ba9-f2e698d04341 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:28.371204 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:28.450823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745c8c4-3ace-4c38-9ba9-f2e698d04341 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:28.485861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8078af-f7be-46d9-92d3-c60a6e268afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:28.486936 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8078af-f7be-46d9-92d3-c60a6e268afa None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:28.487425 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8078af-f7be-46d9-92d3-c60a6e268afa None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:28.487897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8078af-f7be-46d9-92d3-c60a6e268afa None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:28.488813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8078af-f7be-46d9-92d3-c60a6e268afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:28.489329 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8078af-f7be-46d9-92d3-c60a6e268afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:28.490899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8078af-f7be-46d9-92d3-c60a6e268afa None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:28.508354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 472/918] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:28.510007 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89220dca-639e-4619-88e1-58606f259627 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:28.622437 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89220dca-639e-4619-88e1-58606f259627 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:28.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b51969-4b2a-404d-be20-d132e4b22eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:28.657959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b51969-4b2a-404d-be20-d132e4b22eac None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:28.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b51969-4b2a-404d-be20-d132e4b22eac None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:28.658894 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b51969-4b2a-404d-be20-d132e4b22eac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:28.667048 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b51969-4b2a-404d-be20-d132e4b22eac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:28.668753 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b51969-4b2a-404d-be20-d132e4b22eac None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-d8b51969-4b2a-404d-be20-d132e4b22eac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:28.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:28.684710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:28.685695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:28.685695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:28.685695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:28.685695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:28.685695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:28.685695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:28.685695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:28.685695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:28.685695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:28.685695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:28.692828 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 447/919] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Jul 24 00:53:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:28.694515 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8078af-f7be-46d9-92d3-c60a6e268afa None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:28.768627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:28.805080 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8078af-f7be-46d9-92d3-c60a6e268afa None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:28.851838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3139670-ec95-4397-bc84-13c601aa0929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:28.852874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3139670-ec95-4397-bc84-13c601aa0929 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:28.853397 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3139670-ec95-4397-bc84-13c601aa0929 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:28.853876 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3139670-ec95-4397-bc84-13c601aa0929 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:28.854923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3139670-ec95-4397-bc84-13c601aa0929 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:28.855502 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3139670-ec95-4397-bc84-13c601aa0929 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:28.857234 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3139670-ec95-4397-bc84-13c601aa0929 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:28.872455 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694988a9-158f-4b9b-8e51-c21b852bcf0c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:28.873978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694988a9-158f-4b9b-8e51-c21b852bcf0c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:28.875006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694988a9-158f-4b9b-8e51-c21b852bcf0c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:28.880220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 473/921] 10.222.0.43 () {56 vars in 1149 bytes} [Sun Jul 24 00:53:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:28.880560 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 448/921] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:28.881892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881cb0d-dedf-467f-8879-552e46d90403 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:28.882180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881cb0d-dedf-467f-8879-552e46d90403 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:28.882485 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881cb0d-dedf-467f-8879-552e46d90403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:28.884288 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694988a9-158f-4b9b-8e51-c21b852bcf0c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:28.898652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:28.899154 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0881cb0d-dedf-467f-8879-552e46d90403 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:28.900348 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0881cb0d-dedf-467f-8879-552e46d90403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:28.971794 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 474/922] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:28.993830 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881cb0d-dedf-467f-8879-552e46d90403 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.026867 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694988a9-158f-4b9b-8e51-c21b852bcf0c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.054222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:29.075516 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3fd63-2cb5-466c-a1d9-2e57f64118f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.077160 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3fd63-2cb5-466c-a1d9-2e57f64118f3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.077928 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3fd63-2cb5-466c-a1d9-2e57f64118f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.078430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3fd63-2cb5-466c-a1d9-2e57f64118f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.092920 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3fd63-2cb5-466c-a1d9-2e57f64118f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.094886 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3fd63-2cb5-466c-a1d9-2e57f64118f3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.097756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881cb0d-dedf-467f-8879-552e46d90403 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-66a3fd63-2cb5-466c-a1d9-2e57f64118f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:29.116210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:29.117139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:29.118076 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:29.118076 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:29.118076 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:29.118076 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:29.125148 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 449/923] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:29.126630 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3fd63-2cb5-466c-a1d9-2e57f64118f3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.132374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c179e40-5677-4e33-8605-8b6d50d779ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.133184 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c179e40-5677-4e33-8605-8b6d50d779ea None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.133551 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c179e40-5677-4e33-8605-8b6d50d779ea None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.133824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c179e40-5677-4e33-8605-8b6d50d779ea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.134477 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c179e40-5677-4e33-8605-8b6d50d779ea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.135886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c179e40-5677-4e33-8605-8b6d50d779ea None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-8c179e40-5677-4e33-8605-8b6d50d779ea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:29.148226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:29.149243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:29.150763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 475/924] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:29.155945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c179e40-5677-4e33-8605-8b6d50d779ea None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.197313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:29.243614 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3fd63-2cb5-466c-a1d9-2e57f64118f3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.265762 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c179e40-5677-4e33-8605-8b6d50d779ea None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.281486 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c4482-97ea-46a3-8e6f-a943c29fea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.282597 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c4482-97ea-46a3-8e6f-a943c29fea2c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.283108 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c4482-97ea-46a3-8e6f-a943c29fea2c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.283584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c4482-97ea-46a3-8e6f-a943c29fea2c None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.284641 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c4482-97ea-46a3-8e6f-a943c29fea2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:29.285279 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c4482-97ea-46a3-8e6f-a943c29fea2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.286885 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c4482-97ea-46a3-8e6f-a943c29fea2c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.291782 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:29.307239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b4b96-bba8-4aa3-be75-5a09917c262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.307239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b4b96-bba8-4aa3-be75-5a09917c262e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.307239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b4b96-bba8-4aa3-be75-5a09917c262e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.307239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b4b96-bba8-4aa3-be75-5a09917c262e None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.307656 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b4b96-bba8-4aa3-be75-5a09917c262e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:29.307656 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b4b96-bba8-4aa3-be75-5a09917c262e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.308010 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b4b96-bba8-4aa3-be75-5a09917c262e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.308254 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 450/925] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:29.309935 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c4482-97ea-46a3-8e6f-a943c29fea2c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.313702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 476/926] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:29.318983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b4b96-bba8-4aa3-be75-5a09917c262e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.415181 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c4482-97ea-46a3-8e6f-a943c29fea2c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.436941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:29.445989 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b4b96-bba8-4aa3-be75-5a09917c262e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.452727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226248b-b5cc-4d04-99e5-67a6683cafec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.453579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226248b-b5cc-4d04-99e5-67a6683cafec None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.453858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226248b-b5cc-4d04-99e5-67a6683cafec None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.454145 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226248b-b5cc-4d04-99e5-67a6683cafec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.461359 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226248b-b5cc-4d04-99e5-67a6683cafec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.462816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226248b-b5cc-4d04-99e5-67a6683cafec None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b226248b-b5cc-4d04-99e5-67a6683cafec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:29.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:29.478187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:29.479319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:29.479319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:29.479319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:29.479319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:29.479319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:29.479319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:29.479319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:29.479319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:29.483455 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 451/927] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:29.484806 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48617007-8655-4918-af30-ad6955fafeb1 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.485103 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48617007-8655-4918-af30-ad6955fafeb1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.485406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48617007-8655-4918-af30-ad6955fafeb1 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.486473 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912230ac-8614-469c-a3db-e687a80b123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.486707 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 452/928] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:29.487396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48617007-8655-4918-af30-ad6955fafeb1 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.487635 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912230ac-8614-469c-a3db-e687a80b123a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.488050 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912230ac-8614-469c-a3db-e687a80b123a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.488326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912230ac-8614-469c-a3db-e687a80b123a None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.489040 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912230ac-8614-469c-a3db-e687a80b123a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:29.489547 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912230ac-8614-469c-a3db-e687a80b123a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.490895 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912230ac-8614-469c-a3db-e687a80b123a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.501533 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 477/929] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:29.502715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a21c31-5a5a-476b-9447-91c3b3fe7947 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.502977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a21c31-5a5a-476b-9447-91c3b3fe7947 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.503278 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a21c31-5a5a-476b-9447-91c3b3fe7947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.519775 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-68a21c31-5a5a-476b-9447-91c3b3fe7947 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:29.521014 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-68a21c31-5a5a-476b-9447-91c3b3fe7947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:29.570437 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:29.597492 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 478/930] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:29.598249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a21c31-5a5a-476b-9447-91c3b3fe7947 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.617774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48617007-8655-4918-af30-ad6955fafeb1 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.656225 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8873a84-880a-4868-9765-41d19524da1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.656903 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8873a84-880a-4868-9765-41d19524da1f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.657246 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8873a84-880a-4868-9765-41d19524da1f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.657497 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8873a84-880a-4868-9765-41d19524da1f None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.658378 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8873a84-880a-4868-9765-41d19524da1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:29.658615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8873a84-880a-4868-9765-41d19524da1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.660057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8873a84-880a-4868-9765-41d19524da1f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.673475 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 453/931] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:29.677608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8873a84-880a-4868-9765-41d19524da1f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.701459 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a21c31-5a5a-476b-9447-91c3b3fe7947 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.722754 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:29.738017 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8114a-db1a-4a35-a787-54028a91ffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.738695 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8114a-db1a-4a35-a787-54028a91ffe1 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.738981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8114a-db1a-4a35-a787-54028a91ffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.739414 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8114a-db1a-4a35-a787-54028a91ffe1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.739995 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8114a-db1a-4a35-a787-54028a91ffe1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.741414 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8114a-db1a-4a35-a787-54028a91ffe1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.763329 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 479/932] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:29.764173 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8114a-db1a-4a35-a787-54028a91ffe1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.798601 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8873a84-880a-4868-9765-41d19524da1f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.819720 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:29.864603 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4f062-8fd8-4938-95a8-b436c79b5572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.865784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4f062-8fd8-4938-95a8-b436c79b5572 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.866116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4f062-8fd8-4938-95a8-b436c79b5572 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.866329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4f062-8fd8-4938-95a8-b436c79b5572 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.866992 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4f062-8fd8-4938-95a8-b436c79b5572 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.868393 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4f062-8fd8-4938-95a8-b436c79b5572 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-a1c4f062-8fd8-4938-95a8-b436c79b5572 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:29.881171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:29.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:29.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 454/933] 10.222.0.43 () {56 vars in 1132 bytes} [Sun Jul 24 00:53:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:29.885010 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67b1f6-ded1-465e-bf3f-e39b3b4f6b7f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.885010 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67b1f6-ded1-465e-bf3f-e39b3b4f6b7f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.885010 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67b1f6-ded1-465e-bf3f-e39b3b4f6b7f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.885949 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 455/934] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:29.888712 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67b1f6-ded1-465e-bf3f-e39b3b4f6b7f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.912125 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8114a-db1a-4a35-a787-54028a91ffe1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.954222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12392424-b345-42f5-b885-7a732703d2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.955371 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12392424-b345-42f5-b885-7a732703d2d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.955483 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12392424-b345-42f5-b885-7a732703d2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.955706 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12392424-b345-42f5-b885-7a732703d2d5 None admin] PATH_INFO: `/v3/projects/f5b7f081bd694cce90cca76194df476e/users/8a465bdbfe3248679adc15154a152d23/roles/bf43109eef0844758450a191d35cf485` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.958291 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12392424-b345-42f5-b885-7a732703d2d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7f081bd694cce90cca76194df476e, user_id=8a465bdbfe3248679adc15154a152d23, role_id=bf43109eef0844758450a191d35cf485)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.959733 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12392424-b345-42f5-b885-7a732703d2d5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.981228 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 480/935] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:53:29 2022] PUT /identity/v3/projects/f5b7f081bd694cce90cca76194df476e/users/8a465bdbfe3248679adc15154a152d23/roles/bf43109eef0844758450a191d35cf485 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:53:29.981228 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d4d5-fe9a-4d33-9e3a-60ddc64ad9a3 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.981228 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d4d5-fe9a-4d33-9e3a-60ddc64ad9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.981228 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d4d5-fe9a-4d33-9e3a-60ddc64ad9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.998669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a334d4d5-fe9a-4d33-9e3a-60ddc64ad9a3 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:29.999909 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a334d4d5-fe9a-4d33-9e3a-60ddc64ad9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:30.026724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:30.033798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67b1f6-ded1-465e-bf3f-e39b3b4f6b7f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.081488 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 481/936] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:30.089093 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9d059-4ff8-4950-9acf-2c8986b4adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.089843 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9d059-4ff8-4950-9acf-2c8986b4adde None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.090122 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9d059-4ff8-4950-9acf-2c8986b4adde None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.090394 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9d059-4ff8-4950-9acf-2c8986b4adde None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.091123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9d059-4ff8-4950-9acf-2c8986b4adde None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:30.091425 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9d059-4ff8-4950-9acf-2c8986b4adde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.092822 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9d059-4ff8-4950-9acf-2c8986b4adde None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.098801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 456/937] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:30.104871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334d4d5-fe9a-4d33-9e3a-60ddc64ad9a3 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.109396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9d059-4ff8-4950-9acf-2c8986b4adde None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.138778 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:30.239454 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9d059-4ff8-4950-9acf-2c8986b4adde None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.244564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334d4d5-fe9a-4d33-9e3a-60ddc64ad9a3 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.275529 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cf3a6-bee2-492e-86db-470c9152f51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.276336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cf3a6-bee2-492e-86db-470c9152f51f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.276615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cf3a6-bee2-492e-86db-470c9152f51f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.276911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cf3a6-bee2-492e-86db-470c9152f51f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.277655 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cf3a6-bee2-492e-86db-470c9152f51f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.279816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cf3a6-bee2-492e-86db-470c9152f51f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.289256 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a03f5c-ffb8-46c9-8a03-4efb6c054674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.290512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a03f5c-ffb8-46c9-8a03-4efb6c054674 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.290979 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a03f5c-ffb8-46c9-8a03-4efb6c054674 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.291431 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a03f5c-ffb8-46c9-8a03-4efb6c054674 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.292340 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a03f5c-ffb8-46c9-8a03-4efb6c054674 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:30.292908 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a03f5c-ffb8-46c9-8a03-4efb6c054674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-551cf3a6-bee2-492e-86db-470c9152f51f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:30.293027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:30.294150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:30.299975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 457/938] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:30.300799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a03f5c-ffb8-46c9-8a03-4efb6c054674 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.302733 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cf3a6-bee2-492e-86db-470c9152f51f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.313240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 482/939] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:30.314795 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a03f5c-ffb8-46c9-8a03-4efb6c054674 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.333386 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:30.408553 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cf3a6-bee2-492e-86db-470c9152f51f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.412145 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:30.421472 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a03f5c-ffb8-46c9-8a03-4efb6c054674 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.446577 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc05f3-ce9d-42eb-aba0-e058bce1fb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.447369 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc05f3-ce9d-42eb-aba0-e058bce1fb6f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.447704 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc05f3-ce9d-42eb-aba0-e058bce1fb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.447960 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc05f3-ce9d-42eb-aba0-e058bce1fb6f None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.448635 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc05f3-ce9d-42eb-aba0-e058bce1fb6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:30.448970 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc05f3-ce9d-42eb-aba0-e058bce1fb6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.450512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc05f3-ce9d-42eb-aba0-e058bce1fb6f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.456430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 458/940] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:30.462795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc05f3-ce9d-42eb-aba0-e058bce1fb6f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.469290 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70bcb8-e31c-4b4c-bb08-2ec738af0204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.470076 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70bcb8-e31c-4b4c-bb08-2ec738af0204 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.470458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70bcb8-e31c-4b4c-bb08-2ec738af0204 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.470827 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70bcb8-e31c-4b4c-bb08-2ec738af0204 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.471679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70bcb8-e31c-4b4c-bb08-2ec738af0204 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.473170 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70bcb8-e31c-4b4c-bb08-2ec738af0204 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.509345 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 483/941] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:53:30.573306 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:30.585482 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc05f3-ce9d-42eb-aba0-e058bce1fb6f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.629433 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3490b0b-dc6a-4056-8845-a8292783ee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.630129 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3490b0b-dc6a-4056-8845-a8292783ee63 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.630401 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3490b0b-dc6a-4056-8845-a8292783ee63 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.630676 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3490b0b-dc6a-4056-8845-a8292783ee63 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.631406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3490b0b-dc6a-4056-8845-a8292783ee63 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:30.631704 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3490b0b-dc6a-4056-8845-a8292783ee63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.633250 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3490b0b-dc6a-4056-8845-a8292783ee63 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.639547 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 459/942] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:30.645725 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70bcb8-e31c-4b4c-bb08-2ec738af0204 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.752231 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70bcb8-e31c-4b4c-bb08-2ec738af0204 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.787120 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3465fcc-b743-4365-ba96-a1b8d161d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.787715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3465fcc-b743-4365-ba96-a1b8d161d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.787985 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3465fcc-b743-4365-ba96-a1b8d161d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.788261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3465fcc-b743-4365-ba96-a1b8d161d0c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.789055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3465fcc-b743-4365-ba96-a1b8d161d0c9 None admin] RBAC: Adding query filter params (interface=public, service_id=219b9a8198c64c3484e6b323a5f1ecfa, region_id=RegionOne) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:30.789467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3465fcc-b743-4365-ba96-a1b8d161d0c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.790844 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3465fcc-b743-4365-ba96-a1b8d161d0c9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.796769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 484/943] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/endpoints?service_id=219b9a8198c64c3484e6b323a5f1ecfa&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:30.802519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3490b0b-dc6a-4056-8845-a8292783ee63 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.907070 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3490b0b-dc6a-4056-8845-a8292783ee63 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.941264 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84357-4498-47c6-983c-aa7459403f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.941944 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84357-4498-47c6-983c-aa7459403f64 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.942227 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84357-4498-47c6-983c-aa7459403f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.942510 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84357-4498-47c6-983c-aa7459403f64 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.943199 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b84357-4498-47c6-983c-aa7459403f64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.944579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b84357-4498-47c6-983c-aa7459403f64 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.951245 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 460/944] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 00:53:31.890178 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d60eb-b846-4b6a-b92a-4c80f7bf7aa7 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:31.890684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d60eb-b846-4b6a-b92a-4c80f7bf7aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:31.890684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d60eb-b846-4b6a-b92a-4c80f7bf7aa7 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:31.892271 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 485/945] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:31.897513 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a56373-2915-42f7-8a03-90330d446125 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:31.897804 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a56373-2915-42f7-8a03-90330d446125 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:31.898083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a56373-2915-42f7-8a03-90330d446125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:31.915441 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-94a56373-2915-42f7-8a03-90330d446125 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:31.916624 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-94a56373-2915-42f7-8a03-90330d446125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:31.927736 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:31.985410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 461/946] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:32.008150 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d60eb-b846-4b6a-b92a-4c80f7bf7aa7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.024567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:32.031341 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e8d3-aad2-4c7f-b17e-eb07bd06672e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.031629 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e8d3-aad2-4c7f-b17e-eb07bd06672e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.031903 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e8d3-aad2-4c7f-b17e-eb07bd06672e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.033299 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 462/947] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:32.039963 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1e590-fd9c-4dfc-bc79-2e8ff2a3c85c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.040255 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1e590-fd9c-4dfc-bc79-2e8ff2a3c85c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.040533 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1e590-fd9c-4dfc-bc79-2e8ff2a3c85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.060872 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a0e1e590-fd9c-4dfc-bc79-2e8ff2a3c85c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:32.062538 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a0e1e590-fd9c-4dfc-bc79-2e8ff2a3c85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:32.137815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d60eb-b846-4b6a-b92a-4c80f7bf7aa7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.149360 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 463/948] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:32.168903 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1e590-fd9c-4dfc-bc79-2e8ff2a3c85c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.185028 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aff20e-e636-45a8-88d3-f9094a448dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.186052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aff20e-e636-45a8-88d3-f9094a448dd3 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.186525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aff20e-e636-45a8-88d3-f9094a448dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.186990 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aff20e-e636-45a8-88d3-f9094a448dd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.187893 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aff20e-e636-45a8-88d3-f9094a448dd3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.189538 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aff20e-e636-45a8-88d3-f9094a448dd3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.191126 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: WARNING keystone.server.flask.common [None req-f3aff20e-e636-45a8-88d3-f9094a448dd3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 24 00:53:32.211241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.sql.core [None req-f3aff20e-e636-45a8-88d3-f9094a448dd3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 24 00:53:32.211241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 24 00:53:32.211241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [parameters: {'id': '6cc0f4caaf094805957d8a4e08858553', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 24 00:53:32.211241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80201) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-f3aff20e-e636-45a8-88d3-f9094a448dd3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6cc0f4caaf094805957d8a4e08858553.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6cc0f4caaf094805957d8a4e08858553. Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:53:32.232813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application result.read() Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 24 00:53:32.233802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application yield resource Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self.session.rollback() Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self.force_reraise() Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise self.value Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application session.commit() Jul 24 00:53:32.234750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._prepare_impl() Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self.session.flush() Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._flush(objects) Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application compat.raise_( Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application flush_context.execute() Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 00:53:32.235663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rec.execute(self) Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 24 00:53:32.236530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application result.read() Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:53:32.237351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [parameters: {'id': '6cc0f4caaf094805957d8a4e08858553', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:32.238240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:32.239026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:32.239928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:32.239928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 24 00:53:32.239928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 24 00:53:32.239928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:32.239928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:32.239928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 24 00:53:32.239928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 24 00:53:32.239928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6cc0f4caaf094805957d8a4e08858553. Jul 24 00:53:32.239928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:32.243518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 486/949] 10.222.0.43 () {60 vars in 1140 bytes} [Sun Jul 24 00:53:32 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:32.253341 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aff20e-e636-45a8-88d3-f9094a448dd3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.259117 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:32.288263 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1e590-fd9c-4dfc-bc79-2e8ff2a3c85c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.329307 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:32.333392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad2282-3c11-42c9-9bae-c114a8556cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.334479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad2282-3c11-42c9-9bae-c114a8556cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.334820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad2282-3c11-42c9-9bae-c114a8556cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.335167 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad2282-3c11-42c9-9bae-c114a8556cd9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.352077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad2282-3c11-42c9-9bae-c114a8556cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-8cad2282-3c11-42c9-9bae-c114a8556cd9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:32.363112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:32.364271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:32.365372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:32.365372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:32.365372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:32.365372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:32.365372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:32.365372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:32.365372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:32.365372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:32.365372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:32.365372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:32.365372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:32.365372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:32.367408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 464/950] 10.222.0.43 () {56 vars in 1120 bytes} [Sun Jul 24 00:53:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:32.372702 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad2282-3c11-42c9-9bae-c114a8556cd9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.378160 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aff20e-e636-45a8-88d3-f9094a448dd3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.426493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f6e2e-55ee-4ae4-954b-34b4c5aa1a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.428119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f6e2e-55ee-4ae4-954b-34b4c5aa1a66 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.428796 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f6e2e-55ee-4ae4-954b-34b4c5aa1a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.429278 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f6e2e-55ee-4ae4-954b-34b4c5aa1a66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.439290 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f6e2e-55ee-4ae4-954b-34b4c5aa1a66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.441742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f6e2e-55ee-4ae4-954b-34b4c5aa1a66 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-3b6f6e2e-55ee-4ae4-954b-34b4c5aa1a66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:32.461100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:32.462079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:32.462967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:32.462967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:32.462967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:32.462967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:32.462967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:32.462967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:32.462967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:32.462967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:32.465367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 487/951] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:32.471582 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f6e2e-55ee-4ae4-954b-34b4c5aa1a66 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.493622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad2282-3c11-42c9-9bae-c114a8556cd9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.549566 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990b6d1-08f5-4224-b307-f445366c76af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.549566 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990b6d1-08f5-4224-b307-f445366c76af None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.549871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990b6d1-08f5-4224-b307-f445366c76af None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.549957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990b6d1-08f5-4224-b307-f445366c76af None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.550696 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990b6d1-08f5-4224-b307-f445366c76af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:32.550998 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990b6d1-08f5-4224-b307-f445366c76af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.553232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990b6d1-08f5-4224-b307-f445366c76af None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.556188 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:32.569852 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 465/952] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Jul 24 00:53:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:32.571971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990b6d1-08f5-4224-b307-f445366c76af None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.610641 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f6e2e-55ee-4ae4-954b-34b4c5aa1a66 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.638637 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:32.647551 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3e8c0-9c00-4143-8e73-e04942de98d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.648220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3e8c0-9c00-4143-8e73-e04942de98d5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.648501 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3e8c0-9c00-4143-8e73-e04942de98d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.648772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3e8c0-9c00-4143-8e73-e04942de98d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.649565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3e8c0-9c00-4143-8e73-e04942de98d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:32.649870 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3e8c0-9c00-4143-8e73-e04942de98d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.651304 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3e8c0-9c00-4143-8e73-e04942de98d5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.673451 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 488/953] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:32.674720 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24033d-eb72-4545-a868-d05913c78962 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.675006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24033d-eb72-4545-a868-d05913c78962 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.675266 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24033d-eb72-4545-a868-d05913c78962 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.676743 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 489/954] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:32.682312 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d47d8-9218-4269-8326-2082c96f28d0 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.682649 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d47d8-9218-4269-8326-2082c96f28d0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.682881 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d47d8-9218-4269-8326-2082c96f28d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.688307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990b6d1-08f5-4224-b307-f445366c76af None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-450d47d8-9218-4269-8326-2082c96f28d0 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:32.711772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-450d47d8-9218-4269-8326-2082c96f28d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:32.753444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef52b2-4157-40ad-8ac5-7c232f775815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.754967 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef52b2-4157-40ad-8ac5-7c232f775815 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.755814 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef52b2-4157-40ad-8ac5-7c232f775815 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.756569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef52b2-4157-40ad-8ac5-7c232f775815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.771753 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef52b2-4157-40ad-8ac5-7c232f775815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.774176 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef52b2-4157-40ad-8ac5-7c232f775815 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b3ef52b2-4157-40ad-8ac5-7c232f775815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:32.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:32.799739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:32.800808 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:32.800808 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:32.800808 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:32.800808 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:32.804091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 466/955] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:32.809590 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef52b2-4157-40ad-8ac5-7c232f775815 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.811886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 490/956] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:32.838209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d47d8-9218-4269-8326-2082c96f28d0 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.867778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:32.934621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef52b2-4157-40ad-8ac5-7c232f775815 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.953191 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d47d8-9218-4269-8326-2082c96f28d0 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.974967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:32.978490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd88ac-fb05-4ac4-a0e9-8e1db2452736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.979783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd88ac-fb05-4ac4-a0e9-8e1db2452736 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.980157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd88ac-fb05-4ac4-a0e9-8e1db2452736 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.980909 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd88ac-fb05-4ac4-a0e9-8e1db2452736 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.982232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd88ac-fb05-4ac4-a0e9-8e1db2452736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:32.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd88ac-fb05-4ac4-a0e9-8e1db2452736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.984626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd88ac-fb05-4ac4-a0e9-8e1db2452736 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.991878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238479b5-985f-47d4-be34-b95c0e3c804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.993081 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238479b5-985f-47d4-be34-b95c0e3c804f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.993620 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238479b5-985f-47d4-be34-b95c0e3c804f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.994097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238479b5-985f-47d4-be34-b95c0e3c804f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.994953 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238479b5-985f-47d4-be34-b95c0e3c804f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.996569 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238479b5-985f-47d4-be34-b95c0e3c804f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:33.003721 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 467/957] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:33.006191 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd88ac-fb05-4ac4-a0e9-8e1db2452736 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-238479b5-985f-47d4-be34-b95c0e3c804f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:33.012033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:33.013148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:33.014423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 491/958] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:33.022452 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238479b5-985f-47d4-be34-b95c0e3c804f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.111837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd88ac-fb05-4ac4-a0e9-8e1db2452736 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:33.123887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:33.136407 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238479b5-985f-47d4-be34-b95c0e3c804f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:33.150282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11361cb5-e070-4a79-b56b-a4ddabdfeea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:33.151194 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361cb5-e070-4a79-b56b-a4ddabdfeea5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.151543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361cb5-e070-4a79-b56b-a4ddabdfeea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.152017 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361cb5-e070-4a79-b56b-a4ddabdfeea5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.159291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11361cb5-e070-4a79-b56b-a4ddabdfeea5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:33.160748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11361cb5-e070-4a79-b56b-a4ddabdfeea5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:33.171401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ed1b2-0840-4c42-899b-8af29db028c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:33.172074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ed1b2-0840-4c42-899b-8af29db028c0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.172361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ed1b2-0840-4c42-899b-8af29db028c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.172637 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ed1b2-0840-4c42-899b-8af29db028c0 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.173380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ed1b2-0840-4c42-899b-8af29db028c0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:33.173688 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ed1b2-0840-4c42-899b-8af29db028c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:33.175047 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ed1b2-0840-4c42-899b-8af29db028c0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-11361cb5-e070-4a79-b56b-a4ddabdfeea5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:33.175746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:33.176708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:33.178193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:33.178193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:33.178193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:33.178193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:33.178193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:33.178193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:33.178193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:33.178193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:33.178193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:33.178193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:33.178193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 468/959] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Jul 24 00:53:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:33.178823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40736984-7c06-48d7-be9a-747ff4af2918 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.179145 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40736984-7c06-48d7-be9a-747ff4af2918 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.179242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40736984-7c06-48d7-be9a-747ff4af2918 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.180566 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 469/960] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:33.185457 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40736984-7c06-48d7-be9a-747ff4af2918 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.190761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 492/961] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:33.190761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5243dc-4076-48fb-9c6e-55bfa70da027 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.190761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5243dc-4076-48fb-9c6e-55bfa70da027 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.190761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5243dc-4076-48fb-9c6e-55bfa70da027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.205882 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-9c5243dc-4076-48fb-9c6e-55bfa70da027 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:33.207086 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9c5243dc-4076-48fb-9c6e-55bfa70da027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:33.253108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:33.280270 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 493/962] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:33.281594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5243dc-4076-48fb-9c6e-55bfa70da027 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.312560 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40736984-7c06-48d7-be9a-747ff4af2918 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:33.350454 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd17e8-97b1-4334-8ba7-c4a079687732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:33.351141 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd17e8-97b1-4334-8ba7-c4a079687732 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.351427 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd17e8-97b1-4334-8ba7-c4a079687732 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.351712 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd17e8-97b1-4334-8ba7-c4a079687732 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.352564 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd17e8-97b1-4334-8ba7-c4a079687732 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:33.352875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd17e8-97b1-4334-8ba7-c4a079687732 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:33.354377 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd17e8-97b1-4334-8ba7-c4a079687732 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:33.373062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 470/963] 10.222.0.43 () {56 vars in 1149 bytes} [Sun Jul 24 00:53:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:33.374137 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd17e8-97b1-4334-8ba7-c4a079687732 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.396695 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5243dc-4076-48fb-9c6e-55bfa70da027 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:33.402396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:33.440521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42458cdf-9af7-4af4-8f9d-13da51b30fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:33.441191 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42458cdf-9af7-4af4-8f9d-13da51b30fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.441499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42458cdf-9af7-4af4-8f9d-13da51b30fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.441770 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42458cdf-9af7-4af4-8f9d-13da51b30fd9 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.442579 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42458cdf-9af7-4af4-8f9d-13da51b30fd9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:33.442843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42458cdf-9af7-4af4-8f9d-13da51b30fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:33.444433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42458cdf-9af7-4af4-8f9d-13da51b30fd9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:33.453530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 494/964] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:33.455162 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42458cdf-9af7-4af4-8f9d-13da51b30fd9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.481102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd17e8-97b1-4334-8ba7-c4a079687732 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:33.520796 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914693f-34ce-4766-b143-e53af3eafb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:33.521852 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914693f-34ce-4766-b143-e53af3eafb50 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.522786 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914693f-34ce-4766-b143-e53af3eafb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.522786 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914693f-34ce-4766-b143-e53af3eafb50 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.523374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914693f-34ce-4766-b143-e53af3eafb50 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:33.524905 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914693f-34ce-4766-b143-e53af3eafb50 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:33.525814 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-8914693f-34ce-4766-b143-e53af3eafb50 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:33.541414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:33.542608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:33.543469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:33.546436 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 471/965] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:33.552697 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914693f-34ce-4766-b143-e53af3eafb50 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.611136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42458cdf-9af7-4af4-8f9d-13da51b30fd9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:33.660866 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebef4f-d121-4736-bc39-712c9058bea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:33.661564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebef4f-d121-4736-bc39-712c9058bea0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.661849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebef4f-d121-4736-bc39-712c9058bea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.662126 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebef4f-d121-4736-bc39-712c9058bea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.674332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:33.684316 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914693f-34ce-4766-b143-e53af3eafb50 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:33.721288 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da7306-0c55-42b4-b917-fd7f3f4dd68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:33.722222 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7306-0c55-42b4-b917-fd7f3f4dd68f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.722664 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7306-0c55-42b4-b917-fd7f3f4dd68f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.723086 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7306-0c55-42b4-b917-fd7f3f4dd68f None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.723962 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da7306-0c55-42b4-b917-fd7f3f4dd68f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:33.724423 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da7306-0c55-42b4-b917-fd7f3f4dd68f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:33.726089 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da7306-0c55-42b4-b917-fd7f3f4dd68f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:33.731837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 472/966] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:33.736470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebef4f-d121-4736-bc39-712c9058bea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:33.737185 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebef4f-d121-4736-bc39-712c9058bea0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:33.737859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da7306-0c55-42b4-b917-fd7f3f4dd68f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.779329 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:33.842380 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da7306-0c55-42b4-b917-fd7f3f4dd68f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:33.842685 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 495/967] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:33 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:33.848125 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebef4f-d121-4736-bc39-712c9058bea0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.877744 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353dda5-6816-4356-ac28-38d7b1298416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:33.878675 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353dda5-6816-4356-ac28-38d7b1298416 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.879151 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353dda5-6816-4356-ac28-38d7b1298416 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.879581 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353dda5-6816-4356-ac28-38d7b1298416 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.880449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353dda5-6816-4356-ac28-38d7b1298416 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:33.880905 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353dda5-6816-4356-ac28-38d7b1298416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:33.882517 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353dda5-6816-4356-ac28-38d7b1298416 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:33.892960 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 473/968] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:33.894324 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353dda5-6816-4356-ac28-38d7b1298416 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.930187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:33.981321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebef4f-d121-4736-bc39-712c9058bea0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:34.021041 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353dda5-6816-4356-ac28-38d7b1298416 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:34.026574 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bcd00-80e2-42bf-8a06-a090580f4e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:34.027417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bcd00-80e2-42bf-8a06-a090580f4e48 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.027684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bcd00-80e2-42bf-8a06-a090580f4e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.027961 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bcd00-80e2-42bf-8a06-a090580f4e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.039045 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:34.042068 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bcd00-80e2-42bf-8a06-a090580f4e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:34.044252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bcd00-80e2-42bf-8a06-a090580f4e48 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:34.057923 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7d7f6-7cc2-4ce3-941a-3d2e5b74d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:34.058724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7d7f6-7cc2-4ce3-941a-3d2e5b74d5a7 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.059103 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7d7f6-7cc2-4ce3-941a-3d2e5b74d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.059473 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7d7f6-7cc2-4ce3-941a-3d2e5b74d5a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.060317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7d7f6-7cc2-4ce3-941a-3d2e5b74d5a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:34.061823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7d7f6-7cc2-4ce3-941a-3d2e5b74d5a7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-264bcd00-80e2-42bf-8a06-a090580f4e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:34.067705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:34.068769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:34.069938 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:34.069938 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:34.069938 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:34.069938 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:34.076979 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 496/969] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:34.078517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bcd00-80e2-42bf-8a06-a090580f4e48 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:34.096499 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 474/970] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:34.198226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bcd00-80e2-42bf-8a06-a090580f4e48 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:34.244363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c485ce1-83f8-4489-ad65-340f3bbe115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:34.245036 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c485ce1-83f8-4489-ad65-340f3bbe115d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.245411 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c485ce1-83f8-4489-ad65-340f3bbe115d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.245690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c485ce1-83f8-4489-ad65-340f3bbe115d None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.246481 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c485ce1-83f8-4489-ad65-340f3bbe115d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:34.246785 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c485ce1-83f8-4489-ad65-340f3bbe115d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:34.248171 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c485ce1-83f8-4489-ad65-340f3bbe115d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:34.262375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 497/971] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:34.266918 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7d7f6-7cc2-4ce3-941a-3d2e5b74d5a7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:34.349673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:34.373920 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7d7f6-7cc2-4ce3-941a-3d2e5b74d5a7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:34.408209 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8493d2-e31a-44fe-b1c8-7ee104f64050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:34.409023 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8493d2-e31a-44fe-b1c8-7ee104f64050 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.409337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8493d2-e31a-44fe-b1c8-7ee104f64050 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.409613 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8493d2-e31a-44fe-b1c8-7ee104f64050 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.416482 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8493d2-e31a-44fe-b1c8-7ee104f64050 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:34.418061 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8493d2-e31a-44fe-b1c8-7ee104f64050 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-1b8493d2-e31a-44fe-b1c8-7ee104f64050 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:34.432233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:34.433337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:34.434816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:34.434816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:34.434816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:34.434816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:34.434816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:34.434816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:34.434816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:34.434816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:34.434816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 475/972] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:34.439467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c485ce1-83f8-4489-ad65-340f3bbe115d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:34.492319 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:34.545460 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c485ce1-83f8-4489-ad65-340f3bbe115d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:34.581693 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4d9e2-c038-4140-a2de-0e0a7a208233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:34.582389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4d9e2-c038-4140-a2de-0e0a7a208233 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.583167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4d9e2-c038-4140-a2de-0e0a7a208233 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.583446 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4d9e2-c038-4140-a2de-0e0a7a208233 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.584356 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4d9e2-c038-4140-a2de-0e0a7a208233 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:34.584670 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4d9e2-c038-4140-a2de-0e0a7a208233 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:34.589233 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4d9e2-c038-4140-a2de-0e0a7a208233 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:34.599332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 498/973] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:34.605472 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8493d2-e31a-44fe-b1c8-7ee104f64050 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:34.711700 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8493d2-e31a-44fe-b1c8-7ee104f64050 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:34.746601 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf93d8c-b495-4e7c-92de-c5767604f8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:34.747266 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf93d8c-b495-4e7c-92de-c5767604f8fc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.747547 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf93d8c-b495-4e7c-92de-c5767604f8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.747823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf93d8c-b495-4e7c-92de-c5767604f8fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.748663 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf93d8c-b495-4e7c-92de-c5767604f8fc None admin] RBAC: Adding query filter params (role.id=bf43109eef0844758450a191d35cf485, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=8a465bdbfe3248679adc15154a152d23) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:34.748976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf93d8c-b495-4e7c-92de-c5767604f8fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:34.750452 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf93d8c-b495-4e7c-92de-c5767604f8fc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:34.753429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:34.756916 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 476/974] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:34 2022] GET /identity/v3/role_assignments?user.id=8a465bdbfe3248679adc15154a152d23&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=bf43109eef0844758450a191d35cf485 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:34.853673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d6525-d713-4fbc-9c87-9d335f62853c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.853890 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d6525-d713-4fbc-9c87-9d335f62853c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.854132 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d6525-d713-4fbc-9c87-9d335f62853c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.855847 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 499/975] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:34.861425 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb405075-1b05-428d-82ee-9775ab1d6738 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.861847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb405075-1b05-428d-82ee-9775ab1d6738 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.862220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb405075-1b05-428d-82ee-9775ab1d6738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.880721 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-eb405075-1b05-428d-82ee-9775ab1d6738 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:34.881999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-eb405075-1b05-428d-82ee-9775ab1d6738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:34.952645 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 477/976] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:34.976843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d6525-d713-4fbc-9c87-9d335f62853c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:35.080823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d6525-d713-4fbc-9c87-9d335f62853c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:35.090898 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:35.116483 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea453be-19dd-43d7-915f-c050ebc4ebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:35.117083 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea453be-19dd-43d7-915f-c050ebc4ebd9 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.117405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea453be-19dd-43d7-915f-c050ebc4ebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.117817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea453be-19dd-43d7-915f-c050ebc4ebd9 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.118541 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea453be-19dd-43d7-915f-c050ebc4ebd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:35.120083 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea453be-19dd-43d7-915f-c050ebc4ebd9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:35.134947 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.sql.core [None req-1ea453be-19dd-43d7-915f-c050ebc4ebd9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 24 00:53:35.134947 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 24 00:53:35.134947 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [parameters: {'user_id': '31c2878c82cf491a9ad0daea0489c690', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 24 00:53:35.134947 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80201) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-1ea453be-19dd-43d7-915f-c050ebc4ebd9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application result.read() Jul 24 00:53:35.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:53:35.144983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application yield resource Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self.session.rollback() Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self.force_reraise() Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise self.value Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application session.commit() Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 24 00:53:35.147265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._prepare_impl() Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self.session.flush() Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._flush(objects) Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application compat.raise_( Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application flush_context.execute() Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rec.execute(self) Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 00:53:35.153801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:53:35.156007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application result.read() Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:53:35.158093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [parameters: {'user_id': '31c2878c82cf491a9ad0daea0489c690', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:35.160108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 24 00:53:35.162167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 24 00:53:35.164336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 24 00:53:35.164336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 24 00:53:35.164336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 24 00:53:35.164336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 24 00:53:35.164336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 24 00:53:35.164336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:35.164336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 500/977] 10.222.0.43 () {60 vars in 1131 bytes} [Sun Jul 24 00:53:34 2022] POST /identity/v3/users => generated 160 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:35.173334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb405075-1b05-428d-82ee-9775ab1d6738 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:35.252884 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb405075-1b05-428d-82ee-9775ab1d6738 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:35.285602 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:35.291871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eceb014-dd2d-4c09-b25a-bee8b599c176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:35.292776 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceb014-dd2d-4c09-b25a-bee8b599c176 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.293230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceb014-dd2d-4c09-b25a-bee8b599c176 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.293542 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceb014-dd2d-4c09-b25a-bee8b599c176 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.301587 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eceb014-dd2d-4c09-b25a-bee8b599c176 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:35.303093 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eceb014-dd2d-4c09-b25a-bee8b599c176 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-4eceb014-dd2d-4c09-b25a-bee8b599c176 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:35.319464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:35.321741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:35.323046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:35.323046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:35.323046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:35.323046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:35.323046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:35.323046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:35.323046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:35.323046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:35.323046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:53:35.323046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:35.323046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 478/978] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:35.330290 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea453be-19dd-43d7-915f-c050ebc4ebd9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:35.432785 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea453be-19dd-43d7-915f-c050ebc4ebd9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:35.474036 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b3539-22ac-4f0f-acf3-0c975a2d3c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:35.474720 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b3539-22ac-4f0f-acf3-0c975a2d3c88 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.475006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b3539-22ac-4f0f-acf3-0c975a2d3c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.475276 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b3539-22ac-4f0f-acf3-0c975a2d3c88 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.476100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b3539-22ac-4f0f-acf3-0c975a2d3c88 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:35.476405 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b3539-22ac-4f0f-acf3-0c975a2d3c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:35.478072 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b3539-22ac-4f0f-acf3-0c975a2d3c88 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:35.516268 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 501/979] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Jul 24 00:53:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:35.589987 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525f65b-a24f-4dbf-9066-2baf522c6e89 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.589987 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525f65b-a24f-4dbf-9066-2baf522c6e89 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.589987 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525f65b-a24f-4dbf-9066-2baf522c6e89 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.590858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 479/980] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:35.597180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1394-98cc-4208-be0f-71c6e546cacc None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.597865 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1394-98cc-4208-be0f-71c6e546cacc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.598372 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1394-98cc-4208-be0f-71c6e546cacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.617113 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-862b1394-98cc-4208-be0f-71c6e546cacc None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:35.619091 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-862b1394-98cc-4208-be0f-71c6e546cacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:35.644975 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:35.697874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 502/981] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:35.722654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525f65b-a24f-4dbf-9066-2baf522c6e89 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:35.830146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525f65b-a24f-4dbf-9066-2baf522c6e89 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:35.864032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fca812-3a5f-446b-80c4-dc172d1c9681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:35.864761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fca812-3a5f-446b-80c4-dc172d1c9681 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.865026 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fca812-3a5f-446b-80c4-dc172d1c9681 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.865345 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fca812-3a5f-446b-80c4-dc172d1c9681 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.866098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fca812-3a5f-446b-80c4-dc172d1c9681 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:35.867474 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fca812-3a5f-446b-80c4-dc172d1c9681 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:35.893232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 480/982] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:35 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:36.242204 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f92987-1985-42fd-b85b-910d600e073e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.242764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f92987-1985-42fd-b85b-910d600e073e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.242764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f92987-1985-42fd-b85b-910d600e073e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.244153 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 503/983] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:36.249639 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcba1a-c725-49fa-9c6d-ea11bc26748e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.250050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcba1a-c725-49fa-9c6d-ea11bc26748e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.250244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcba1a-c725-49fa-9c6d-ea11bc26748e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.267603 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8bbcba1a-c725-49fa-9c6d-ea11bc26748e None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:36.268796 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8bbcba1a-c725-49fa-9c6d-ea11bc26748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:36.318010 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:36.347986 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 481/984] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:36.370679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f92987-1985-42fd-b85b-910d600e073e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:36.476135 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f92987-1985-42fd-b85b-910d600e073e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:36.509535 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fde6a3-6503-475a-8ede-e303e3dfdc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:36.510267 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fde6a3-6503-475a-8ede-e303e3dfdc71 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.510543 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fde6a3-6503-475a-8ede-e303e3dfdc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.510842 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fde6a3-6503-475a-8ede-e303e3dfdc71 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.511492 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fde6a3-6503-475a-8ede-e303e3dfdc71 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:36.512861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fde6a3-6503-475a-8ede-e303e3dfdc71 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-61fde6a3-6503-475a-8ede-e303e3dfdc71 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:36.524924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:36.525962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:36.527005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:36.528471 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 504/985] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:36.532950 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcba1a-c725-49fa-9c6d-ea11bc26748e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:36.646877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcba1a-c725-49fa-9c6d-ea11bc26748e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:36.681503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129621-3f46-4973-8ef4-a8560f1654be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:36.682180 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129621-3f46-4973-8ef4-a8560f1654be None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.682466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129621-3f46-4973-8ef4-a8560f1654be None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.682794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129621-3f46-4973-8ef4-a8560f1654be None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.683512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63129621-3f46-4973-8ef4-a8560f1654be None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:36.683819 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63129621-3f46-4973-8ef4-a8560f1654be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:36.685232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63129621-3f46-4973-8ef4-a8560f1654be None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:36.690397 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 482/986] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:36.696018 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fde6a3-6503-475a-8ede-e303e3dfdc71 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:36.722260 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:36.800496 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fde6a3-6503-475a-8ede-e303e3dfdc71 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:36.834676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9ff1-82d4-47cb-8960-684494fcfaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:36.835398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9ff1-82d4-47cb-8960-684494fcfaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.835667 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9ff1-82d4-47cb-8960-684494fcfaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.835947 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9ff1-82d4-47cb-8960-684494fcfaa5 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.836667 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9ff1-82d4-47cb-8960-684494fcfaa5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:36.836966 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9ff1-82d4-47cb-8960-684494fcfaa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:36.838358 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9ff1-82d4-47cb-8960-684494fcfaa5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:36.843611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 505/987] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:36.849524 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129621-3f46-4973-8ef4-a8560f1654be None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:36.891654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:36.896551 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0ebae-13c7-4457-9dd4-c7638f37e834 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.896828 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0ebae-13c7-4457-9dd4-c7638f37e834 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.897106 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0ebae-13c7-4457-9dd4-c7638f37e834 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.898535 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 506/988] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:36.903308 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafaf34-8a13-4290-8125-aa8232c1abe2 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.903592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafaf34-8a13-4290-8125-aa8232c1abe2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.903862 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafaf34-8a13-4290-8125-aa8232c1abe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.921617 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7fafaf34-8a13-4290-8125-aa8232c1abe2 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:36.922785 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7fafaf34-8a13-4290-8125-aa8232c1abe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:36.952284 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129621-3f46-4973-8ef4-a8560f1654be None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:36.986329 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253faca-f2e7-4a97-8336-b54a1993740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:36.987396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253faca-f2e7-4a97-8336-b54a1993740e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.987826 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253faca-f2e7-4a97-8336-b54a1993740e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.988114 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253faca-f2e7-4a97-8336-b54a1993740e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.988951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253faca-f2e7-4a97-8336-b54a1993740e None admin] RBAC: Adding query filter params (interface=admin, service_id=219b9a8198c64c3484e6b323a5f1ecfa, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:36.989293 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253faca-f2e7-4a97-8336-b54a1993740e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:36.990723 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253faca-f2e7-4a97-8336-b54a1993740e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:36.996757 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 483/989] 10.222.0.43 () {56 vars in 1249 bytes} [Sun Jul 24 00:53:36 2022] GET /identity/v3/endpoints?service_id=219b9a8198c64c3484e6b323a5f1ecfa&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:36.999685 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 507/990] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:37.003245 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253faca-f2e7-4a97-8336-b54a1993740e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:37.021584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafaf34-8a13-4290-8125-aa8232c1abe2 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:37.040201 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:37.111423 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253faca-f2e7-4a97-8336-b54a1993740e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:37.114553 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:37.133683 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafaf34-8a13-4290-8125-aa8232c1abe2 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:37.147044 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724b51-c69c-4681-8729-bf427877c089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:37.147712 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724b51-c69c-4681-8729-bf427877c089 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:37.148018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724b51-c69c-4681-8729-bf427877c089 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:37.148341 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724b51-c69c-4681-8729-bf427877c089 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:37.149003 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94724b51-c69c-4681-8729-bf427877c089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:37.150422 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94724b51-c69c-4681-8729-bf427877c089 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:37.156863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 484/991] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:37 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 00:53:37.169602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a9e68-9c61-4f38-8e23-fe00bf2884a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:37.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a9e68-9c61-4f38-8e23-fe00bf2884a8 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:37.170784 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a9e68-9c61-4f38-8e23-fe00bf2884a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:37.171056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a9e68-9c61-4f38-8e23-fe00bf2884a8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:37.171727 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a9e68-9c61-4f38-8e23-fe00bf2884a8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:37.173150 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a9e68-9c61-4f38-8e23-fe00bf2884a8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-5f3a9e68-9c61-4f38-8e23-fe00bf2884a8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:37.186112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:37.187212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:37.188055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:37.192701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 508/992] 10.222.0.43 () {56 vars in 1105 bytes} [Sun Jul 24 00:53:37 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:37.197253 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724b51-c69c-4681-8729-bf427877c089 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:37.326721 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724b51-c69c-4681-8729-bf427877c089 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:37.366604 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ce981-5fb1-403b-94c1-37f3f6f3ab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:37.367332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ce981-5fb1-403b-94c1-37f3f6f3ab65 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:37.367610 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ce981-5fb1-403b-94c1-37f3f6f3ab65 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:37.367879 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ce981-5fb1-403b-94c1-37f3f6f3ab65 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:37.368592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ce981-5fb1-403b-94c1-37f3f6f3ab65 None admin] RBAC: Adding query filter params (name=image) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:37.368900 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ce981-5fb1-403b-94c1-37f3f6f3ab65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:37.370586 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ce981-5fb1-403b-94c1-37f3f6f3ab65 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:37.376108 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 485/993] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:37.382054 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a9e68-9c61-4f38-8e23-fe00bf2884a8 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:37.474375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:37.499683 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a9e68-9c61-4f38-8e23-fe00bf2884a8 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:37.537501 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4014170-c0f4-43c0-93de-a685c7fa55d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:37.538177 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4014170-c0f4-43c0-93de-a685c7fa55d5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:37.538453 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4014170-c0f4-43c0-93de-a685c7fa55d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:37.538729 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4014170-c0f4-43c0-93de-a685c7fa55d5 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:37.539517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4014170-c0f4-43c0-93de-a685c7fa55d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:37.540054 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4014170-c0f4-43c0-93de-a685c7fa55d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:37.542205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4014170-c0f4-43c0-93de-a685c7fa55d5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:37.547746 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 509/994] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:37.920051 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0028a1-4d47-4b8d-9797-19bcba396c91 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:37.920313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0028a1-4d47-4b8d-9797-19bcba396c91 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:37.920817 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0028a1-4d47-4b8d-9797-19bcba396c91 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:37.922475 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 486/995] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:37.927735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fd183-1f41-4455-bf0f-5be42b071af8 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:37.927995 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fd183-1f41-4455-bf0f-5be42b071af8 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:37.928554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fd183-1f41-4455-bf0f-5be42b071af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:37.945869 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-bc0fd183-1f41-4455-bf0f-5be42b071af8 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:37.947059 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bc0fd183-1f41-4455-bf0f-5be42b071af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:38.018903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 510/996] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:38.042585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0028a1-4d47-4b8d-9797-19bcba396c91 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:38.076060 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:38.151253 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0028a1-4d47-4b8d-9797-19bcba396c91 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:38.186842 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d83e13-171d-42b8-a21b-26e709ffa90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:38.187569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d83e13-171d-42b8-a21b-26e709ffa90d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.187849 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d83e13-171d-42b8-a21b-26e709ffa90d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.188126 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d83e13-171d-42b8-a21b-26e709ffa90d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.189194 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d83e13-171d-42b8-a21b-26e709ffa90d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:38.190611 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d83e13-171d-42b8-a21b-26e709ffa90d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-36d83e13-171d-42b8-a21b-26e709ffa90d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:38.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:38.203726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:38.204579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:38.206022 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 487/997] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:38.210416 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fd183-1f41-4455-bf0f-5be42b071af8 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:38.288395 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:38.316192 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fd183-1f41-4455-bf0f-5be42b071af8 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:38.351295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba52b2-e6ed-4f07-a35a-e534985647e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:38.351977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba52b2-e6ed-4f07-a35a-e534985647e1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.352259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba52b2-e6ed-4f07-a35a-e534985647e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.352535 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba52b2-e6ed-4f07-a35a-e534985647e1 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.353250 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba52b2-e6ed-4f07-a35a-e534985647e1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:38.353575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba52b2-e6ed-4f07-a35a-e534985647e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:38.355046 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba52b2-e6ed-4f07-a35a-e534985647e1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:38.360319 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 511/998] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:38.365980 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d83e13-171d-42b8-a21b-26e709ffa90d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:38.461184 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:38.468365 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d83e13-171d-42b8-a21b-26e709ffa90d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:38.501306 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf7256-2324-4c47-af57-59a14a3dc367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:38.501972 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7256-2324-4c47-af57-59a14a3dc367 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.502255 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7256-2324-4c47-af57-59a14a3dc367 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.502530 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7256-2324-4c47-af57-59a14a3dc367 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.503237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf7256-2324-4c47-af57-59a14a3dc367 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:38.503543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf7256-2324-4c47-af57-59a14a3dc367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:38.504918 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf7256-2324-4c47-af57-59a14a3dc367 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:38.510074 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 488/999] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:38.515897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba52b2-e6ed-4f07-a35a-e534985647e1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:38.624556 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba52b2-e6ed-4f07-a35a-e534985647e1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:38.659412 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2bb30-9823-430f-bdf7-aa4798ffeb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:38.660074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2bb30-9823-430f-bdf7-aa4798ffeb21 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.660354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2bb30-9823-430f-bdf7-aa4798ffeb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.660627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2bb30-9823-430f-bdf7-aa4798ffeb21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.661443 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2bb30-9823-430f-bdf7-aa4798ffeb21 None admin] RBAC: Adding query filter params (interface=public, service_id=c3b0a6d3348f4e2ea99dc01f341ff3d5, region_id=RegionOne) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:38.661751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2bb30-9823-430f-bdf7-aa4798ffeb21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:38.663129 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2bb30-9823-430f-bdf7-aa4798ffeb21 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:38.669374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 512/1000] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:38 2022] GET /identity/v3/endpoints?service_id=c3b0a6d3348f4e2ea99dc01f341ff3d5&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:38.675017 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf7256-2324-4c47-af57-59a14a3dc367 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:38.775818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf7256-2324-4c47-af57-59a14a3dc367 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:38.809756 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b02ee-3f68-414e-b82b-941c962c071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:38.810426 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b02ee-3f68-414e-b82b-941c962c071b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.810702 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b02ee-3f68-414e-b82b-941c962c071b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.810971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b02ee-3f68-414e-b82b-941c962c071b None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.811642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b02ee-3f68-414e-b82b-941c962c071b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:38.813024 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b02ee-3f68-414e-b82b-941c962c071b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:38.819476 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 489/1001] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:38 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 00:53:39.235551 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b49751-3b35-4494-b0dc-fe53a2566b1b None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.235808 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b49751-3b35-4494-b0dc-fe53a2566b1b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.236082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b49751-3b35-4494-b0dc-fe53a2566b1b None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.237704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 513/1002] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:39.242939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd940d-b540-4b23-bf21-49669e283322 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.243207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd940d-b540-4b23-bf21-49669e283322 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.243511 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd940d-b540-4b23-bf21-49669e283322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.261265 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a9cd940d-b540-4b23-bf21-49669e283322 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:39.262439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a9cd940d-b540-4b23-bf21-49669e283322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:39.281523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:39.333247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 490/1003] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:39.356205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b49751-3b35-4494-b0dc-fe53a2566b1b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:39.359229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:39.464671 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b49751-3b35-4494-b0dc-fe53a2566b1b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:39.498948 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ca841-4d0c-4021-a997-567e28a2319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:39.499689 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ca841-4d0c-4021-a997-567e28a2319f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.499970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ca841-4d0c-4021-a997-567e28a2319f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.500242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ca841-4d0c-4021-a997-567e28a2319f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.500907 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ca841-4d0c-4021-a997-567e28a2319f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:39.502314 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ca841-4d0c-4021-a997-567e28a2319f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-c59ca841-4d0c-4021-a997-567e28a2319f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:39.514792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:39.515837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:39.517156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:39.518757 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 514/1004] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:39.522710 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd940d-b540-4b23-bf21-49669e283322 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:39.570674 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab81978-a5a6-4e0b-9e5d-491dae151294 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.571000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab81978-a5a6-4e0b-9e5d-491dae151294 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.571246 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab81978-a5a6-4e0b-9e5d-491dae151294 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.573244 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 515/1005] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:39.577839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083c234-60d7-4a29-a4fa-4e518932315e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.578127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083c234-60d7-4a29-a4fa-4e518932315e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.578407 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083c234-60d7-4a29-a4fa-4e518932315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.598930 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b083c234-60d7-4a29-a4fa-4e518932315e None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:39.600156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b083c234-60d7-4a29-a4fa-4e518932315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:39.633149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd940d-b540-4b23-bf21-49669e283322 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:39.667501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf5ed5-96a0-4ea6-b460-489cb1b75333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:39.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5ed5-96a0-4ea6-b460-489cb1b75333 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.668466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5ed5-96a0-4ea6-b460-489cb1b75333 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.668740 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5ed5-96a0-4ea6-b460-489cb1b75333 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.669316 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:39.669475 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf5ed5-96a0-4ea6-b460-489cb1b75333 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:39.669780 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf5ed5-96a0-4ea6-b460-489cb1b75333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:39.671216 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf5ed5-96a0-4ea6-b460-489cb1b75333 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:39.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 491/1006] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:39.680731 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 516/1007] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:39.686299 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf5ed5-96a0-4ea6-b460-489cb1b75333 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:39.700146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083c234-60d7-4a29-a4fa-4e518932315e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:39.705716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:39.789829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf5ed5-96a0-4ea6-b460-489cb1b75333 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:39.815385 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083c234-60d7-4a29-a4fa-4e518932315e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:39.825634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d7c7b-9c80-419e-9cba-9bcbd34febbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:39.826314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7c7b-9c80-419e-9cba-9bcbd34febbe None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.826601 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7c7b-9c80-419e-9cba-9bcbd34febbe None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.826879 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7c7b-9c80-419e-9cba-9bcbd34febbe None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.827658 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d7c7b-9c80-419e-9cba-9bcbd34febbe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:39.827972 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d7c7b-9c80-419e-9cba-9bcbd34febbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:39.829388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d7c7b-9c80-419e-9cba-9bcbd34febbe None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:39.834940 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 492/1008] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:39.840547 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d7c7b-9c80-419e-9cba-9bcbd34febbe None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:39.852155 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2c6ab-4465-4219-aa58-0608bbbbae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:39.852836 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2c6ab-4465-4219-aa58-0608bbbbae7d None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.853152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2c6ab-4465-4219-aa58-0608bbbbae7d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.853425 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2c6ab-4465-4219-aa58-0608bbbbae7d None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.854188 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2c6ab-4465-4219-aa58-0608bbbbae7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:39.855590 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2c6ab-4465-4219-aa58-0608bbbbae7d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:39.870451 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 517/1009] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:39 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:53:39.937064 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:39.959442 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d7c7b-9c80-419e-9cba-9bcbd34febbe None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:40.006276 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1af0a9-774f-4a1c-830d-dbe4233f9395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:40.006948 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1af0a9-774f-4a1c-830d-dbe4233f9395 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:40.007226 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1af0a9-774f-4a1c-830d-dbe4233f9395 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:40.007493 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1af0a9-774f-4a1c-830d-dbe4233f9395 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:40.008277 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1af0a9-774f-4a1c-830d-dbe4233f9395 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:40.009780 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1af0a9-774f-4a1c-830d-dbe4233f9395 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:40.030052 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 493/1010] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:53:40.850879 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae49fe0-1107-4545-a1b0-59cb7a69817c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:40.851411 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae49fe0-1107-4545-a1b0-59cb7a69817c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:40.851411 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae49fe0-1107-4545-a1b0-59cb7a69817c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:40.852857 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 518/1011] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:40.857985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23f1b4-b604-4f67-8549-ff332db37328 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:40.858401 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23f1b4-b604-4f67-8549-ff332db37328 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:40.858501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23f1b4-b604-4f67-8549-ff332db37328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:40.875256 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-db23f1b4-b604-4f67-8549-ff332db37328 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:40.876429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-db23f1b4-b604-4f67-8549-ff332db37328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:40.948304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 494/1012] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:40 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:40.970818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae49fe0-1107-4545-a1b0-59cb7a69817c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:41.032970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:41.078989 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae49fe0-1107-4545-a1b0-59cb7a69817c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:41.113563 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c02a24-6fae-4f4e-b294-0bdc75b9fb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:41.114300 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c02a24-6fae-4f4e-b294-0bdc75b9fb91 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.114584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c02a24-6fae-4f4e-b294-0bdc75b9fb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.114860 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c02a24-6fae-4f4e-b294-0bdc75b9fb91 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.115513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c02a24-6fae-4f4e-b294-0bdc75b9fb91 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:41.116897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c02a24-6fae-4f4e-b294-0bdc75b9fb91 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-49c02a24-6fae-4f4e-b294-0bdc75b9fb91 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:41.128829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:41.129894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:41.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 519/1013] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:41.137249 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23f1b4-b604-4f67-8549-ff332db37328 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:41.203981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:41.244355 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23f1b4-b604-4f67-8549-ff332db37328 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:41.278877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38106f-b719-49d2-97f2-0c0f5b1a4ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:41.279553 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38106f-b719-49d2-97f2-0c0f5b1a4ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.279842 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38106f-b719-49d2-97f2-0c0f5b1a4ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.280117 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38106f-b719-49d2-97f2-0c0f5b1a4ec1 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.280832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38106f-b719-49d2-97f2-0c0f5b1a4ec1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:41.281142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38106f-b719-49d2-97f2-0c0f5b1a4ec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:41.282554 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38106f-b719-49d2-97f2-0c0f5b1a4ec1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:41.292142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 495/1014] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:41.293440 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c02a24-6fae-4f4e-b294-0bdc75b9fb91 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:41.394519 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c02a24-6fae-4f4e-b294-0bdc75b9fb91 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:41.413829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:41.429547 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8a347-e521-4ab2-86a3-e0a8a05f2366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:41.430226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8a347-e521-4ab2-86a3-e0a8a05f2366 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.430514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8a347-e521-4ab2-86a3-e0a8a05f2366 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.430792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8a347-e521-4ab2-86a3-e0a8a05f2366 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.431508 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8a347-e521-4ab2-86a3-e0a8a05f2366 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:41.431816 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8a347-e521-4ab2-86a3-e0a8a05f2366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:41.433304 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8a347-e521-4ab2-86a3-e0a8a05f2366 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:41.442770 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 520/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:41.444077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38106f-b719-49d2-97f2-0c0f5b1a4ec1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:41.549111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38106f-b719-49d2-97f2-0c0f5b1a4ec1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:41.584950 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:41.595317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864c4ea-1a53-4a95-aff8-2b935b9c8f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:41.595992 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864c4ea-1a53-4a95-aff8-2b935b9c8f70 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.596268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864c4ea-1a53-4a95-aff8-2b935b9c8f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.596542 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864c4ea-1a53-4a95-aff8-2b935b9c8f70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.597378 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864c4ea-1a53-4a95-aff8-2b935b9c8f70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:41.598711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864c4ea-1a53-4a95-aff8-2b935b9c8f70 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:41.618881 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 496/1016] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:53:41.922142 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b312e-d70b-46e4-be17-cf520e9da43c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.922716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b312e-d70b-46e4-be17-cf520e9da43c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.923695 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b312e-d70b-46e4-be17-cf520e9da43c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.925145 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 521/1017] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:41.930427 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0a66a-b1fa-49eb-8103-e9ee164e7f01 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.930811 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0a66a-b1fa-49eb-8103-e9ee164e7f01 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.930985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0a66a-b1fa-49eb-8103-e9ee164e7f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.948274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d8f0a66a-b1fa-49eb-8103-e9ee164e7f01 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:41.949498 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d8f0a66a-b1fa-49eb-8103-e9ee164e7f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:42.025308 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 497/1018] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:42.047979 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b312e-d70b-46e4-be17-cf520e9da43c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:42.060536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4ebd5-93a6-4893-8b53-85bf86260365 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:42.060869 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4ebd5-93a6-4893-8b53-85bf86260365 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:42.061067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4ebd5-93a6-4893-8b53-85bf86260365 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:42.062636 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 498/1019] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:42.067519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c6a4f-3772-44ff-8538-4bc3eda77146 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:42.067813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c6a4f-3772-44ff-8538-4bc3eda77146 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:42.068101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c6a4f-3772-44ff-8538-4bc3eda77146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:42.085302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ca5c6a4f-3772-44ff-8538-4bc3eda77146 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:42.086757 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ca5c6a4f-3772-44ff-8538-4bc3eda77146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:42.158558 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 499/1020] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:42.162261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b312e-d70b-46e4-be17-cf520e9da43c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:42.182044 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c6a4f-3772-44ff-8538-4bc3eda77146 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:42.206705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67334c13-d070-4bed-94ac-b98dd94d815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:42.207868 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67334c13-d070-4bed-94ac-b98dd94d815d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:42.208146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67334c13-d070-4bed-94ac-b98dd94d815d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:42.208658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67334c13-d070-4bed-94ac-b98dd94d815d None admin] PATH_INFO: `/v3/services/image` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:42.209058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67334c13-d070-4bed-94ac-b98dd94d815d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:42.210455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67334c13-d070-4bed-94ac-b98dd94d815d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-67334c13-d070-4bed-94ac-b98dd94d815d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:42.222726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:42.223742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:42.224595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 522/1021] 10.222.0.43 () {56 vars in 1105 bytes} [Sun Jul 24 00:53:42 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:42.228278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:42.230530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67334c13-d070-4bed-94ac-b98dd94d815d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:42.283190 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:42.293813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c6a4f-3772-44ff-8538-4bc3eda77146 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:42.329876 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692b56e-ad01-41ea-a665-7cb3e5c751e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:42.330687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692b56e-ad01-41ea-a665-7cb3e5c751e1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:42.330975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692b56e-ad01-41ea-a665-7cb3e5c751e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:42.331239 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692b56e-ad01-41ea-a665-7cb3e5c751e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:42.332771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692b56e-ad01-41ea-a665-7cb3e5c751e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:42.333423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67334c13-d070-4bed-94ac-b98dd94d815d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:42.334243 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692b56e-ad01-41ea-a665-7cb3e5c751e1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:42.336109 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 500/1022] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:42.341803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692b56e-ad01-41ea-a665-7cb3e5c751e1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:42.367746 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea77203-e5fd-43cf-948b-3d5c84745cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:42.368448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea77203-e5fd-43cf-948b-3d5c84745cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:42.368735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea77203-e5fd-43cf-948b-3d5c84745cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:42.369007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea77203-e5fd-43cf-948b-3d5c84745cd7 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:42.369804 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea77203-e5fd-43cf-948b-3d5c84745cd7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:42.370108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea77203-e5fd-43cf-948b-3d5c84745cd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:42.371468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea77203-e5fd-43cf-948b-3d5c84745cd7 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:42.377042 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 523/1023] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:42.382543 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea77203-e5fd-43cf-948b-3d5c84745cd7 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:42.448511 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692b56e-ad01-41ea-a665-7cb3e5c751e1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:42.460584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:42.487403 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea77203-e5fd-43cf-948b-3d5c84745cd7 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:42.488410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072e620-e73e-4fca-b498-919850299eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:42.489080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072e620-e73e-4fca-b498-919850299eeb None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:42.489397 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072e620-e73e-4fca-b498-919850299eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:42.489674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072e620-e73e-4fca-b498-919850299eeb None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:42.490377 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072e620-e73e-4fca-b498-919850299eeb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:42.491805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072e620-e73e-4fca-b498-919850299eeb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:42.500704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:42.525250 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 501/1024] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:42 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:53:42.532494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9bba9-56f8-4e1a-ba40-f8e61751c0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:42.533278 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9bba9-56f8-4e1a-ba40-f8e61751c0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:42.533563 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9bba9-56f8-4e1a-ba40-f8e61751c0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:42.533836 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9bba9-56f8-4e1a-ba40-f8e61751c0e9 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:42.534564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9bba9-56f8-4e1a-ba40-f8e61751c0e9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:42.534867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9bba9-56f8-4e1a-ba40-f8e61751c0e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:42.536287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9bba9-56f8-4e1a-ba40-f8e61751c0e9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:42.542520 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 524/1025] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:42.548927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072e620-e73e-4fca-b498-919850299eeb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:42.671717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072e620-e73e-4fca-b498-919850299eeb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:42.706633 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f163b-15f3-46fa-bb11-0a6477c8a929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:42.707569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f163b-15f3-46fa-bb11-0a6477c8a929 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:42.707857 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f163b-15f3-46fa-bb11-0a6477c8a929 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:42.708120 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f163b-15f3-46fa-bb11-0a6477c8a929 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:42.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f163b-15f3-46fa-bb11-0a6477c8a929 None admin] RBAC: Adding query filter params (interface=public, service_id=98e141b05b344c35b3552dff38b0a325, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:42.709271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f163b-15f3-46fa-bb11-0a6477c8a929 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:42.710621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f163b-15f3-46fa-bb11-0a6477c8a929 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:42.716592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 502/1026] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:42 2022] GET /identity/v3/endpoints?service_id=98e141b05b344c35b3552dff38b0a325&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:42.722417 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9bba9-56f8-4e1a-ba40-f8e61751c0e9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:42.828856 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9bba9-56f8-4e1a-ba40-f8e61751c0e9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:42.864398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c77807-38f8-4d35-9ab9-b9b6bb1434b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:42.865071 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c77807-38f8-4d35-9ab9-b9b6bb1434b0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:42.865381 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c77807-38f8-4d35-9ab9-b9b6bb1434b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:42.865655 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c77807-38f8-4d35-9ab9-b9b6bb1434b0 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:42.866335 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c77807-38f8-4d35-9ab9-b9b6bb1434b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:42.867705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c77807-38f8-4d35-9ab9-b9b6bb1434b0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:42.874460 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 525/1027] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:42 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 00:53:43.727966 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc168e4-1da8-4b46-82b7-1e3260afa206 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:43.728507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc168e4-1da8-4b46-82b7-1e3260afa206 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:43.728507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc168e4-1da8-4b46-82b7-1e3260afa206 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:43.730209 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 503/1028] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:43.735271 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3355e-804d-42d3-9123-258ffe270ac9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:43.735676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3355e-804d-42d3-9123-258ffe270ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:43.735851 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3355e-804d-42d3-9123-258ffe270ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:43.752845 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-43b3355e-804d-42d3-9123-258ffe270ac9 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:43.754067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-43b3355e-804d-42d3-9123-258ffe270ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:43.790462 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:43.824544 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 526/1029] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:43.848153 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc168e4-1da8-4b46-82b7-1e3260afa206 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:43.875040 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:43.954987 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc168e4-1da8-4b46-82b7-1e3260afa206 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:43.992110 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d4bfa-88ae-4b50-8d6b-aad9361a1577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:43.993245 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d4bfa-88ae-4b50-8d6b-aad9361a1577 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:43.993667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d4bfa-88ae-4b50-8d6b-aad9361a1577 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:43.994080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d4bfa-88ae-4b50-8d6b-aad9361a1577 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.005002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d4bfa-88ae-4b50-8d6b-aad9361a1577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-8a3d4bfa-88ae-4b50-8d6b-aad9361a1577 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:44.013626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:44.014637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:44.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 504/1030] 10.222.0.43 () {56 vars in 1120 bytes} [Sun Jul 24 00:53:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:44.021816 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3355e-804d-42d3-9123-258ffe270ac9 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.124186 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3355e-804d-42d3-9123-258ffe270ac9 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.158966 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919c3b0-4682-40e7-bf6c-510509ee8ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.159642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919c3b0-4682-40e7-bf6c-510509ee8ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.159913 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919c3b0-4682-40e7-bf6c-510509ee8ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.160183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919c3b0-4682-40e7-bf6c-510509ee8ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.160920 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919c3b0-4682-40e7-bf6c-510509ee8ce4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:44.161235 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919c3b0-4682-40e7-bf6c-510509ee8ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.162613 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919c3b0-4682-40e7-bf6c-510509ee8ce4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.170990 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 527/1031] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:44.176536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d4bfa-88ae-4b50-8d6b-aad9361a1577 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.259632 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:44.277237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d4bfa-88ae-4b50-8d6b-aad9361a1577 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.310455 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afdb1b-7065-4123-8e7f-005770eaf9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.311249 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afdb1b-7065-4123-8e7f-005770eaf9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.311536 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afdb1b-7065-4123-8e7f-005770eaf9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.311836 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afdb1b-7065-4123-8e7f-005770eaf9a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.322823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afdb1b-7065-4123-8e7f-005770eaf9a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.324279 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afdb1b-7065-4123-8e7f-005770eaf9a7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-51afdb1b-7065-4123-8e7f-005770eaf9a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:44.341771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:44.342678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:44.343608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:44.343608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:44.343608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:44.343608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:44.345563 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 505/1032] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:44.348719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919c3b0-4682-40e7-bf6c-510509ee8ce4 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.381465 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:44.458874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919c3b0-4682-40e7-bf6c-510509ee8ce4 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.499349 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81047e27-93cd-40c0-afb0-ad22028dca1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.500224 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81047e27-93cd-40c0-afb0-ad22028dca1d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.500598 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81047e27-93cd-40c0-afb0-ad22028dca1d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.500975 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81047e27-93cd-40c0-afb0-ad22028dca1d None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.502075 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81047e27-93cd-40c0-afb0-ad22028dca1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:44.502526 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81047e27-93cd-40c0-afb0-ad22028dca1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.504510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81047e27-93cd-40c0-afb0-ad22028dca1d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.517864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 528/1033] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:44.523311 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afdb1b-7065-4123-8e7f-005770eaf9a7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.630403 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cf49a-6ecd-48a0-86e5-f01fa9778910 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.630694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cf49a-6ecd-48a0-86e5-f01fa9778910 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.630936 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cf49a-6ecd-48a0-86e5-f01fa9778910 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.632389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 529/1034] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:44.636572 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afdb1b-7065-4123-8e7f-005770eaf9a7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.637461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec49d8-7a26-4bfc-a004-ed43b613b52c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.638783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec49d8-7a26-4bfc-a004-ed43b613b52c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.640503 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec49d8-7a26-4bfc-a004-ed43b613b52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.658600 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2aec49d8-7a26-4bfc-a004-ed43b613b52c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:44.659791 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2aec49d8-7a26-4bfc-a004-ed43b613b52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:44.674800 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a699-342a-4a7f-b992-46d3ece724b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.675821 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a699-342a-4a7f-b992-46d3ece724b4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.676236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a699-342a-4a7f-b992-46d3ece724b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.676514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a699-342a-4a7f-b992-46d3ece724b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.679319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:44.685067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212a699-342a-4a7f-b992-46d3ece724b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.686997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212a699-342a-4a7f-b992-46d3ece724b4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-3212a699-342a-4a7f-b992-46d3ece724b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:44.700845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:44.701976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:44.703242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:44.703242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:44.703242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:44.703242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:44.703242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:44.703242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:44.703242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:44.703242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:44.703242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:44.703242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:44.703242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 506/1035] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:44.708029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a699-342a-4a7f-b992-46d3ece724b4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.733777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 530/1036] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:44.758069 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec49d8-7a26-4bfc-a004-ed43b613b52c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.784113 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:44.811894 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a699-342a-4a7f-b992-46d3ece724b4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.852276 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e2a5c-4151-4c18-80a6-5b6aae85d071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2a5c-4151-4c18-80a6-5b6aae85d071 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.854016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2a5c-4151-4c18-80a6-5b6aae85d071 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.854559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2a5c-4151-4c18-80a6-5b6aae85d071 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.855771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e2a5c-4151-4c18-80a6-5b6aae85d071 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:44.856192 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e2a5c-4151-4c18-80a6-5b6aae85d071 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.857815 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e2a5c-4151-4c18-80a6-5b6aae85d071 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.865107 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec49d8-7a26-4bfc-a004-ed43b613b52c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.876683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 507/1037] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:44.882117 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e2a5c-4151-4c18-80a6-5b6aae85d071 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.901732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab5fbe-f94b-4ddc-b212-a80344c6dbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.902457 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab5fbe-f94b-4ddc-b212-a80344c6dbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.902753 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab5fbe-f94b-4ddc-b212-a80344c6dbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.903008 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab5fbe-f94b-4ddc-b212-a80344c6dbc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.904168 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab5fbe-f94b-4ddc-b212-a80344c6dbc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.905632 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab5fbe-f94b-4ddc-b212-a80344c6dbc0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.907271 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 531/1038] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:44.908565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fcc59-eac7-4692-9f2c-1a7c36f746b2 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.908849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fcc59-eac7-4692-9f2c-1a7c36f746b2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.909120 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fcc59-eac7-4692-9f2c-1a7c36f746b2 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.910347 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 532/1039] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:44.912711 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fcc59-eac7-4692-9f2c-1a7c36f746b2 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.940832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:44.986507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e2a5c-4151-4c18-80a6-5b6aae85d071 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:45.006728 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:45.018073 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fcc59-eac7-4692-9f2c-1a7c36f746b2 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:45.021506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1884d-673e-48d5-a2c5-14bdbb3ed541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:45.022195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1884d-673e-48d5-a2c5-14bdbb3ed541 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.022476 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1884d-673e-48d5-a2c5-14bdbb3ed541 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.022754 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1884d-673e-48d5-a2c5-14bdbb3ed541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.058196 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e24b74-0952-4742-acc3-749cb3ff8ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:45.058870 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24b74-0952-4742-acc3-749cb3ff8ef8 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.059146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24b74-0952-4742-acc3-749cb3ff8ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.059414 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24b74-0952-4742-acc3-749cb3ff8ef8 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.060112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e24b74-0952-4742-acc3-749cb3ff8ef8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:45.061574 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e24b74-0952-4742-acc3-749cb3ff8ef8 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:45.082488 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 533/1040] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:53:44 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:45.083902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e178e11-0e43-49da-a69b-b205ba29d00f None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.084198 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e178e11-0e43-49da-a69b-b205ba29d00f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.084481 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e178e11-0e43-49da-a69b-b205ba29d00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.101891 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0e178e11-0e43-49da-a69b-b205ba29d00f None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:45.103141 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0e178e11-0e43-49da-a69b-b205ba29d00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:45.104623 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1884d-673e-48d5-a2c5-14bdbb3ed541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:45.106201 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1884d-673e-48d5-a2c5-14bdbb3ed541 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:45.175193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:45.178974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 534/1041] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:45.201843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e178e11-0e43-49da-a69b-b205ba29d00f None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:45.232350 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 508/1042] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:53:45.233931 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1884d-673e-48d5-a2c5-14bdbb3ed541 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:45.302978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:45.335086 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e178e11-0e43-49da-a69b-b205ba29d00f None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:45.344382 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1884d-673e-48d5-a2c5-14bdbb3ed541 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:45.370056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2ac51-2174-4595-83f4-e1d74f790a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:45.370857 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2ac51-2174-4595-83f4-e1d74f790a06 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.371140 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2ac51-2174-4595-83f4-e1d74f790a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.371396 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2ac51-2174-4595-83f4-e1d74f790a06 None admin] PATH_INFO: `/v3/services/image` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.372067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2ac51-2174-4595-83f4-e1d74f790a06 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:45.373437 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2ac51-2174-4595-83f4-e1d74f790a06 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:45.381141 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09f42e-abe4-4004-a7a4-b69d0f138fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:45.381981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f42e-abe4-4004-a7a4-b69d0f138fac None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.382264 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f42e-abe4-4004-a7a4-b69d0f138fac None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.382538 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f42e-abe4-4004-a7a4-b69d0f138fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-61b2ac51-2174-4595-83f4-e1d74f790a06 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:45.385119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:45.386390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:45.387704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 535/1043] 10.222.0.43 () {56 vars in 1105 bytes} [Sun Jul 24 00:53:45 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:45.392186 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2ac51-2174-4595-83f4-e1d74f790a06 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:45.397397 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09f42e-abe4-4004-a7a4-b69d0f138fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:45.398860 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09f42e-abe4-4004-a7a4-b69d0f138fac None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ac09f42e-abe4-4004-a7a4-b69d0f138fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:45.417897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:45.418854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:45.419911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:45.419911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:45.419911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:45.419911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:45.419911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 509/1044] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:45.424661 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09f42e-abe4-4004-a7a4-b69d0f138fac None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:45.433397 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:45.498327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2ac51-2174-4595-83f4-e1d74f790a06 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:45.530032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09f42e-abe4-4004-a7a4-b69d0f138fac None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:45.533629 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202d65a-7ca4-4c16-b60f-801787f090c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:45.534489 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202d65a-7ca4-4c16-b60f-801787f090c3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.534921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202d65a-7ca4-4c16-b60f-801787f090c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.535350 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202d65a-7ca4-4c16-b60f-801787f090c3 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.536194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202d65a-7ca4-4c16-b60f-801787f090c3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:45.536634 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202d65a-7ca4-4c16-b60f-801787f090c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:45.538189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202d65a-7ca4-4c16-b60f-801787f090c3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:45.543659 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 536/1045] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:45.548964 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202d65a-7ca4-4c16-b60f-801787f090c3 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:45.553626 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:45.574455 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d75a8-8e78-4c84-bded-a4e9cd75f754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:45.575777 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d75a8-8e78-4c84-bded-a4e9cd75f754 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.576500 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d75a8-8e78-4c84-bded-a4e9cd75f754 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.576995 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d75a8-8e78-4c84-bded-a4e9cd75f754 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.578188 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d75a8-8e78-4c84-bded-a4e9cd75f754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:45.578770 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d75a8-8e78-4c84-bded-a4e9cd75f754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:45.580631 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d75a8-8e78-4c84-bded-a4e9cd75f754 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:45.596841 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 510/1046] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:45.602847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d75a8-8e78-4c84-bded-a4e9cd75f754 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:45.662303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202d65a-7ca4-4c16-b60f-801787f090c3 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:45.670588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:45.696581 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d178522-d7f3-456a-9dbd-9818f296a8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:45.697566 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d178522-d7f3-456a-9dbd-9818f296a8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.698015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d178522-d7f3-456a-9dbd-9818f296a8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.698449 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d178522-d7f3-456a-9dbd-9818f296a8c9 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.699301 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d178522-d7f3-456a-9dbd-9818f296a8c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:45.699753 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d178522-d7f3-456a-9dbd-9818f296a8c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:45.701289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d178522-d7f3-456a-9dbd-9818f296a8c9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:45.704944 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d75a8-8e78-4c84-bded-a4e9cd75f754 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:45.706478 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 537/1047] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:45.713468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d178522-d7f3-456a-9dbd-9818f296a8c9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:45.749491 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5eb19-2e73-4cfe-9fa5-d497413a587d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:45.750295 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5eb19-2e73-4cfe-9fa5-d497413a587d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.750580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5eb19-2e73-4cfe-9fa5-d497413a587d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.750850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5eb19-2e73-4cfe-9fa5-d497413a587d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.760464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5eb19-2e73-4cfe-9fa5-d497413a587d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:45.762647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5eb19-2e73-4cfe-9fa5-d497413a587d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:45.778806 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-94e5eb19-2e73-4cfe-9fa5-d497413a587d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:45.781512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:45.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:45.783291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:45.783291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:45.783291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:45.783291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:45.783291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:45.783291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:45.783291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:45.783291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:45.788599 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 511/1048] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:45.789415 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5eb19-2e73-4cfe-9fa5-d497413a587d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:45.814950 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d178522-d7f3-456a-9dbd-9818f296a8c9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:45.855288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeee46e-7ea3-480b-ad11-cff44e81cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:45.856060 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeee46e-7ea3-480b-ad11-cff44e81cc82 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.856393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeee46e-7ea3-480b-ad11-cff44e81cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.856671 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeee46e-7ea3-480b-ad11-cff44e81cc82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.857460 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeee46e-7ea3-480b-ad11-cff44e81cc82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:45.858827 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeee46e-7ea3-480b-ad11-cff44e81cc82 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:45.879676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 538/1049] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:53:45.904877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5eb19-2e73-4cfe-9fa5-d497413a587d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:45.934586 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:45.952255 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5078420-1d1b-4b20-9dd5-e99bfd4da5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:45.952844 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5078420-1d1b-4b20-9dd5-e99bfd4da5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.953164 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5078420-1d1b-4b20-9dd5-e99bfd4da5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.953430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5078420-1d1b-4b20-9dd5-e99bfd4da5f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.954917 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5078420-1d1b-4b20-9dd5-e99bfd4da5f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:45.955228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5078420-1d1b-4b20-9dd5-e99bfd4da5f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:45.956701 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5078420-1d1b-4b20-9dd5-e99bfd4da5f2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:45.971263 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 512/1050] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:45.977315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeee46e-7ea3-480b-ad11-cff44e81cc82 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:46.091112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeee46e-7ea3-480b-ad11-cff44e81cc82 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:46.115401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:46.127496 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aca1cf-ace1-4472-a33a-d932bfb9316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:46.128178 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aca1cf-ace1-4472-a33a-d932bfb9316d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:46.128460 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aca1cf-ace1-4472-a33a-d932bfb9316d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:46.128735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aca1cf-ace1-4472-a33a-d932bfb9316d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:46.129611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aca1cf-ace1-4472-a33a-d932bfb9316d None admin] RBAC: Adding query filter params (role.id=bf43109eef0844758450a191d35cf485, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=808b08d1d2df42e587279071a5dba593) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:46.129924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aca1cf-ace1-4472-a33a-d932bfb9316d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:46.131391 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aca1cf-ace1-4472-a33a-d932bfb9316d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:46.137463 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 539/1051] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:45 2022] GET /identity/v3/role_assignments?user.id=808b08d1d2df42e587279071a5dba593&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=bf43109eef0844758450a191d35cf485 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:47.145826 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c459d-7434-4c45-b860-7209f676f6be None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.146363 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c459d-7434-4c45-b860-7209f676f6be None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.146644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c459d-7434-4c45-b860-7209f676f6be None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.147938 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 513/1052] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:47.153476 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fc6ba-31f1-411a-b63f-4667bd6cec6b None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.154121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fc6ba-31f1-411a-b63f-4667bd6cec6b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.154121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fc6ba-31f1-411a-b63f-4667bd6cec6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.171363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5c7fc6ba-31f1-411a-b63f-4667bd6cec6b None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:47.172571 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5c7fc6ba-31f1-411a-b63f-4667bd6cec6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:47.244762 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 540/1053] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:47.267649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c459d-7434-4c45-b860-7209f676f6be None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:47.370667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c459d-7434-4c45-b860-7209f676f6be None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:47.404006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbfbe3-a7e0-4778-a1e5-e88a805ede9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:47.404729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbfbe3-a7e0-4778-a1e5-e88a805ede9b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.405012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbfbe3-a7e0-4778-a1e5-e88a805ede9b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.405306 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbfbe3-a7e0-4778-a1e5-e88a805ede9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.415415 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbfbe3-a7e0-4778-a1e5-e88a805ede9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-e4cbfbe3-a7e0-4778-a1e5-e88a805ede9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:47.423059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:47.424072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:47.424911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:47.424911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:47.424911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:47.424911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:47.424911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:47.424911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:47.424911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:47.424911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:47.424911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:47.424911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:47.424911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:47.424911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:47.429526 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 514/1054] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:47.430413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fc6ba-31f1-411a-b63f-4667bd6cec6b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:47.533800 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fc6ba-31f1-411a-b63f-4667bd6cec6b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:47.551435 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:47.569608 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4f6a3-9084-4619-913b-87bfdb658032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:47.572987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4f6a3-9084-4619-913b-87bfdb658032 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.572987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4f6a3-9084-4619-913b-87bfdb658032 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.572987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4f6a3-9084-4619-913b-87bfdb658032 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.572987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4f6a3-9084-4619-913b-87bfdb658032 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:47.572987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4f6a3-9084-4619-913b-87bfdb658032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:47.573521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4f6a3-9084-4619-913b-87bfdb658032 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:47.587189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 541/1055] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:47.593617 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbfbe3-a7e0-4778-a1e5-e88a805ede9b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:47.641323 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:47.701258 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbfbe3-a7e0-4778-a1e5-e88a805ede9b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:47.735619 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993ce0c-415d-4258-8fd9-bf91f9a6aad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:47.736506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993ce0c-415d-4258-8fd9-bf91f9a6aad7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.736781 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993ce0c-415d-4258-8fd9-bf91f9a6aad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.737050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993ce0c-415d-4258-8fd9-bf91f9a6aad7 None admin] PATH_INFO: `/v3/users/3818ed0b9a20403cba302f7dec567f90` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.750723 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993ce0c-415d-4258-8fd9-bf91f9a6aad7 None admin] RBAC: Authorizing `identity:get_user(user_id=3818ed0b9a20403cba302f7dec567f90)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:47.752193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993ce0c-415d-4258-8fd9-bf91f9a6aad7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:47.754135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 515/1056] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:53:47 2022] GET /identity/v3/users/3818ed0b9a20403cba302f7dec567f90 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:47.759813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4f6a3-9084-4619-913b-87bfdb658032 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:47.861343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4f6a3-9084-4619-913b-87bfdb658032 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:47.894652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447a451-d621-4843-a32f-462e3e648a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:47.895324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a451-d621-4843-a32f-462e3e648a9c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.895593 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a451-d621-4843-a32f-462e3e648a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.895864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a451-d621-4843-a32f-462e3e648a9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.900568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0e0f2-4308-49ee-ae55-02d2cb6e3b7d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.900851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0e0f2-4308-49ee-ae55-02d2cb6e3b7d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.901129 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0e0f2-4308-49ee-ae55-02d2cb6e3b7d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.902666 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 516/1057] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:47.907514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25969258-626e-415a-9e6c-16d5cb626041 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.907798 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25969258-626e-415a-9e6c-16d5cb626041 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.908067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25969258-626e-415a-9e6c-16d5cb626041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.925347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-25969258-626e-415a-9e6c-16d5cb626041 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:47.926551 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-25969258-626e-415a-9e6c-16d5cb626041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:47.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:47.968658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447a451-d621-4843-a32f-462e3e648a9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:47.971192 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447a451-d621-4843-a32f-462e3e648a9c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:47.995915 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 517/1058] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:48.017877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25969258-626e-415a-9e6c-16d5cb626041 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:48.048107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:48.074793 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 542/1059] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:48.080591 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447a451-d621-4843-a32f-462e3e648a9c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:48.122076 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25969258-626e-415a-9e6c-16d5cb626041 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:48.156802 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be928ff-6e23-4c30-ab01-c25504335a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:48.157518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be928ff-6e23-4c30-ab01-c25504335a3c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.157765 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be928ff-6e23-4c30-ab01-c25504335a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.158038 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be928ff-6e23-4c30-ab01-c25504335a3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.161982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:48.180921 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447a451-d621-4843-a32f-462e3e648a9c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:48.214464 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c948cd1-0acb-4428-a532-f28d6df5c68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:48.215325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c948cd1-0acb-4428-a532-f28d6df5c68a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.215611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c948cd1-0acb-4428-a532-f28d6df5c68a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.215881 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c948cd1-0acb-4428-a532-f28d6df5c68a None admin] PATH_INFO: `/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.217047 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c948cd1-0acb-4428-a532-f28d6df5c68a None admin] RBAC: Authorizing `identity:get_project(project_id=4cb800d4dfd44d5f9cdcbf2af3964fb3)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:48.218516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c948cd1-0acb-4428-a532-f28d6df5c68a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:48.220329 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 543/1060] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:53:48 2022] GET /identity/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:48.221446 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf20ea-0e6e-4d67-9075-46fb19001b4b None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.221702 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf20ea-0e6e-4d67-9075-46fb19001b4b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.222007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf20ea-0e6e-4d67-9075-46fb19001b4b None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.223195 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 544/1061] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:48.226132 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf20ea-0e6e-4d67-9075-46fb19001b4b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:48.227897 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be928ff-6e23-4c30-ab01-c25504335a3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:48.229489 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be928ff-6e23-4c30-ab01-c25504335a3c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:48.258377 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:48.326380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf20ea-0e6e-4d67-9075-46fb19001b4b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:48.327318 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 518/1062] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:48.328582 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bae90c-f647-47bc-8c1d-2df6769dd1be None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.328867 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bae90c-f647-47bc-8c1d-2df6769dd1be None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.329142 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bae90c-f647-47bc-8c1d-2df6769dd1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.345489 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-62bae90c-f647-47bc-8c1d-2df6769dd1be None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:48.346668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-62bae90c-f647-47bc-8c1d-2df6769dd1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:48.361613 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f7308-495b-4769-961a-c9199a348988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:48.362268 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f7308-495b-4769-961a-c9199a348988 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.362552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f7308-495b-4769-961a-c9199a348988 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.362821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f7308-495b-4769-961a-c9199a348988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.363644 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f7308-495b-4769-961a-c9199a348988 None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=4cb800d4dfd44d5f9cdcbf2af3964fb3, user.id=3818ed0b9a20403cba302f7dec567f90) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:48.363955 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f7308-495b-4769-961a-c9199a348988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:48.365392 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f7308-495b-4769-961a-c9199a348988 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:48.371032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 545/1063] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:48 2022] GET /identity/v3/role_assignments?user.id=3818ed0b9a20403cba302f7dec567f90&scope.project.id=4cb800d4dfd44d5f9cdcbf2af3964fb3&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:48.371903 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f7308-495b-4769-961a-c9199a348988 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:48.387459 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:48.425116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 519/1064] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:48.448146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bae90c-f647-47bc-8c1d-2df6769dd1be None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:48.485885 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f7308-495b-4769-961a-c9199a348988 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:48.514265 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:48.523834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccc9a5-9b9c-4498-b32b-8c4d8853966e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:48.524733 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccc9a5-9b9c-4498-b32b-8c4d8853966e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.525016 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccc9a5-9b9c-4498-b32b-8c4d8853966e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.525440 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccc9a5-9b9c-4498-b32b-8c4d8853966e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.537056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccc9a5-9b9c-4498-b32b-8c4d8853966e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:48.538562 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccc9a5-9b9c-4498-b32b-8c4d8853966e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-99ccc9a5-9b9c-4498-b32b-8c4d8853966e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:48.557327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:48.558270 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:48.558270 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:48.558270 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:48.558270 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:48.558270 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 546/1065] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:48.563546 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccc9a5-9b9c-4498-b32b-8c4d8853966e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:48.564737 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bae90c-f647-47bc-8c1d-2df6769dd1be None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:48.605314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c12b1-57f2-426d-8039-a81999337475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:48.606149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c12b1-57f2-426d-8039-a81999337475 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.606429 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c12b1-57f2-426d-8039-a81999337475 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.606698 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c12b1-57f2-426d-8039-a81999337475 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.617248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c12b1-57f2-426d-8039-a81999337475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-267c12b1-57f2-426d-8039-a81999337475 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:48.626036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:48.627221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:48.628135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 520/1066] 10.222.0.43 () {56 vars in 1120 bytes} [Sun Jul 24 00:53:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:48.633378 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c12b1-57f2-426d-8039-a81999337475 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:48.634719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:48.674813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccc9a5-9b9c-4498-b32b-8c4d8853966e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:48.714296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c9f94-59c5-4da5-8a40-6a5952131c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:48.714965 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c9f94-59c5-4da5-8a40-6a5952131c77 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.715243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c9f94-59c5-4da5-8a40-6a5952131c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.715508 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c9f94-59c5-4da5-8a40-6a5952131c77 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.716222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c9f94-59c5-4da5-8a40-6a5952131c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:48.716523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c9f94-59c5-4da5-8a40-6a5952131c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:48.717916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c9f94-59c5-4da5-8a40-6a5952131c77 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:48.731032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 547/1067] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:48.744530 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c12b1-57f2-426d-8039-a81999337475 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:48.768470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:48.784549 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943b5e3-ad22-4648-a052-ffd91422c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:48.785284 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943b5e3-ad22-4648-a052-ffd91422c895 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.785563 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943b5e3-ad22-4648-a052-ffd91422c895 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.785830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943b5e3-ad22-4648-a052-ffd91422c895 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.786612 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943b5e3-ad22-4648-a052-ffd91422c895 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:48.786918 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943b5e3-ad22-4648-a052-ffd91422c895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:48.788350 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943b5e3-ad22-4648-a052-ffd91422c895 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:48.798303 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 521/1068] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Jul 24 00:53:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:48.804285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c9f94-59c5-4da5-8a40-6a5952131c77 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:48.915729 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c9f94-59c5-4da5-8a40-6a5952131c77 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:48.940439 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:48.951777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7105dee-e76d-40a7-ab39-1fe3bf3e47db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:48.952585 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7105dee-e76d-40a7-ab39-1fe3bf3e47db None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.952866 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7105dee-e76d-40a7-ab39-1fe3bf3e47db None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.953139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7105dee-e76d-40a7-ab39-1fe3bf3e47db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.963910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7105dee-e76d-40a7-ab39-1fe3bf3e47db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:48.965384 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7105dee-e76d-40a7-ab39-1fe3bf3e47db None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-b7105dee-e76d-40a7-ab39-1fe3bf3e47db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:48.982799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:48.983732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:48.984658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:48.984658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:48.984658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:48.984658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:48.988820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 548/1069] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:48.990257 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943b5e3-ad22-4648-a052-ffd91422c895 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:49.092109 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943b5e3-ad22-4648-a052-ffd91422c895 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:49.126447 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065e7de-3fd3-4584-88e7-eb028bdb7aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:49.127123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065e7de-3fd3-4584-88e7-eb028bdb7aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.127408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065e7de-3fd3-4584-88e7-eb028bdb7aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.127688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065e7de-3fd3-4584-88e7-eb028bdb7aa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.128419 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065e7de-3fd3-4584-88e7-eb028bdb7aa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:49.128726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065e7de-3fd3-4584-88e7-eb028bdb7aa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:49.130145 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065e7de-3fd3-4584-88e7-eb028bdb7aa3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:49.141790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 522/1070] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:49.147716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7105dee-e76d-40a7-ab39-1fe3bf3e47db None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:49.247803 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7105dee-e76d-40a7-ab39-1fe3bf3e47db None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:49.282043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02fd50-1162-45a2-b1ae-f37221432fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:49.282833 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02fd50-1162-45a2-b1ae-f37221432fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.283109 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02fd50-1162-45a2-b1ae-f37221432fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.283375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02fd50-1162-45a2-b1ae-f37221432fe5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.290246 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02fd50-1162-45a2-b1ae-f37221432fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:49.291712 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02fd50-1162-45a2-b1ae-f37221432fe5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-8f02fd50-1162-45a2-b1ae-f37221432fe5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:49.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:49.306886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:49.307850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:49.307850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:49.307850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:49.307850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:49.307850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:49.307850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:49.307850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:49.307850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:49.307850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:49.307850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:49.307850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 549/1071] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Jul 24 00:53:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:49.313159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065e7de-3fd3-4584-88e7-eb028bdb7aa3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:49.359945 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:49.418463 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065e7de-3fd3-4584-88e7-eb028bdb7aa3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:49.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852fcb4-3a8b-43fa-950b-37a70d769a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:49.453156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852fcb4-3a8b-43fa-950b-37a70d769a2a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.453459 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852fcb4-3a8b-43fa-950b-37a70d769a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.453730 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852fcb4-3a8b-43fa-950b-37a70d769a2a None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.454568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852fcb4-3a8b-43fa-950b-37a70d769a2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:49.454872 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852fcb4-3a8b-43fa-950b-37a70d769a2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:49.456298 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852fcb4-3a8b-43fa-950b-37a70d769a2a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:49.474153 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 523/1072] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Jul 24 00:53:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:49.480223 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02fd50-1162-45a2-b1ae-f37221432fe5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:49.516157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:49.588989 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02fd50-1162-45a2-b1ae-f37221432fe5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:49.624306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfa399-6c54-4450-a7c1-61b1a3ef5fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:49.625005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfa399-6c54-4450-a7c1-61b1a3ef5fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.625323 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfa399-6c54-4450-a7c1-61b1a3ef5fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.625577 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfa399-6c54-4450-a7c1-61b1a3ef5fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.635931 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfa399-6c54-4450-a7c1-61b1a3ef5fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:49.637518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfa399-6c54-4450-a7c1-61b1a3ef5fd0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-17bfa399-6c54-4450-a7c1-61b1a3ef5fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:49.656006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:49.657094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:49.658044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:49.658044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:49.658044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:49.658044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:49.658044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 550/1073] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:49.663303 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852fcb4-3a8b-43fa-950b-37a70d769a2a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:49.760666 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:49.764330 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852fcb4-3a8b-43fa-950b-37a70d769a2a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:49.799962 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e9bf2-3767-46c1-bd4a-32d32358e984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:49.800624 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e9bf2-3767-46c1-bd4a-32d32358e984 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.800901 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e9bf2-3767-46c1-bd4a-32d32358e984 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.801170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e9bf2-3767-46c1-bd4a-32d32358e984 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.801921 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e9bf2-3767-46c1-bd4a-32d32358e984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:49.802223 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e9bf2-3767-46c1-bd4a-32d32358e984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:49.803591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e9bf2-3767-46c1-bd4a-32d32358e984 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:49.814915 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 524/1074] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:49.820691 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfa399-6c54-4450-a7c1-61b1a3ef5fd0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:49.914851 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:49.928564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfa399-6c54-4450-a7c1-61b1a3ef5fd0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:49.964278 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669c9a8-6d1a-4e8b-80e8-da7710f73565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:49.965077 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669c9a8-6d1a-4e8b-80e8-da7710f73565 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.965391 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669c9a8-6d1a-4e8b-80e8-da7710f73565 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.965668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669c9a8-6d1a-4e8b-80e8-da7710f73565 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.972599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669c9a8-6d1a-4e8b-80e8-da7710f73565 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:49.974078 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669c9a8-6d1a-4e8b-80e8-da7710f73565 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-6669c9a8-6d1a-4e8b-80e8-da7710f73565 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:49.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:49.989932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:49.990817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:49.990817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:49.990817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:49.990817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:49.990817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:49.990817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:49.990817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:49.990817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:49.990817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 551/1075] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:49.996167 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e9bf2-3767-46c1-bd4a-32d32358e984 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:50.098422 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e9bf2-3767-46c1-bd4a-32d32358e984 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:50.132764 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dff664-0ad3-4137-b3fc-9df440ddb5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:50.133457 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dff664-0ad3-4137-b3fc-9df440ddb5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:50.133739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dff664-0ad3-4137-b3fc-9df440ddb5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:50.133996 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dff664-0ad3-4137-b3fc-9df440ddb5f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:50.134816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dff664-0ad3-4137-b3fc-9df440ddb5f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:50.135123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dff664-0ad3-4137-b3fc-9df440ddb5f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:50.136572 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dff664-0ad3-4137-b3fc-9df440ddb5f0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:50.148761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 525/1076] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:50.154987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669c9a8-6d1a-4e8b-80e8-da7710f73565 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:50.264754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669c9a8-6d1a-4e8b-80e8-da7710f73565 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:50.299856 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3f695-5c72-4a6e-9153-f156a372328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:50.300770 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3f695-5c72-4a6e-9153-f156a372328d None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:50.301052 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3f695-5c72-4a6e-9153-f156a372328d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:50.301367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3f695-5c72-4a6e-9153-f156a372328d None admin] PATH_INFO: `/v3/projects/f5b7f081bd694cce90cca76194df476e/users/808b08d1d2df42e587279071a5dba593/roles/bf43109eef0844758450a191d35cf485` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:50.303651 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3f695-5c72-4a6e-9153-f156a372328d None admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7f081bd694cce90cca76194df476e, user_id=808b08d1d2df42e587279071a5dba593, role_id=bf43109eef0844758450a191d35cf485)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:50.305106 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3f695-5c72-4a6e-9153-f156a372328d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:50.318530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 552/1077] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:53:50 2022] PUT /identity/v3/projects/f5b7f081bd694cce90cca76194df476e/users/808b08d1d2df42e587279071a5dba593/roles/bf43109eef0844758450a191d35cf485 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:53:50.388535 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1492af-835d-4b4f-b757-d64aeadf97e2 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:50.389095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1492af-835d-4b4f-b757-d64aeadf97e2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:50.389095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1492af-835d-4b4f-b757-d64aeadf97e2 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:50.390506 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 526/1078] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:50.396497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d6438-3ef0-4b6d-b69c-9661291627e1 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:50.396760 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d6438-3ef0-4b6d-b69c-9661291627e1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:50.397075 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d6438-3ef0-4b6d-b69c-9661291627e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:50.415363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7d0d6438-3ef0-4b6d-b69c-9661291627e1 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:50.416843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7d0d6438-3ef0-4b6d-b69c-9661291627e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:50.419113 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:50.492010 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 553/1079] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:50.514877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1492af-835d-4b4f-b757-d64aeadf97e2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:50.538480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:50.629244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1492af-835d-4b4f-b757-d64aeadf97e2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:50.664106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7959bee-a2c1-4f78-a23e-cfa834f67fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:50.664904 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959bee-a2c1-4f78-a23e-cfa834f67fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:50.665185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959bee-a2c1-4f78-a23e-cfa834f67fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:50.665487 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959bee-a2c1-4f78-a23e-cfa834f67fa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:50.676073 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7959bee-a2c1-4f78-a23e-cfa834f67fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b7959bee-a2c1-4f78-a23e-cfa834f67fa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:50.683715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:50.684667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:50.685568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 527/1080] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:50.691288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d6438-3ef0-4b6d-b69c-9661291627e1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:50.796807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d6438-3ef0-4b6d-b69c-9661291627e1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:50.832039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d36669-d60f-4ac3-a1b2-f30642c2b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:50.832708 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d36669-d60f-4ac3-a1b2-f30642c2b28d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:50.833004 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d36669-d60f-4ac3-a1b2-f30642c2b28d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:50.833308 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d36669-d60f-4ac3-a1b2-f30642c2b28d None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:50.834069 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d36669-d60f-4ac3-a1b2-f30642c2b28d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:50.834379 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d36669-d60f-4ac3-a1b2-f30642c2b28d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:50.835768 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d36669-d60f-4ac3-a1b2-f30642c2b28d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:50.840981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:50.844993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 554/1081] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:50.850644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7959bee-a2c1-4f78-a23e-cfa834f67fa2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:50.935727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:50.955665 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7959bee-a2c1-4f78-a23e-cfa834f67fa2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:50.989937 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a2e0d-be41-48b8-9e2d-e332fe891b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:50.990836 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a2e0d-be41-48b8-9e2d-e332fe891b1e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:50.991121 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a2e0d-be41-48b8-9e2d-e332fe891b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:50.991402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a2e0d-be41-48b8-9e2d-e332fe891b1e None admin] PATH_INFO: `/v3/users/3818ed0b9a20403cba302f7dec567f90` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:50.992637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a2e0d-be41-48b8-9e2d-e332fe891b1e None admin] RBAC: Authorizing `identity:get_user(user_id=3818ed0b9a20403cba302f7dec567f90)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:50.994130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a2e0d-be41-48b8-9e2d-e332fe891b1e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:50.995783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 528/1082] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:53:50 2022] GET /identity/v3/users/3818ed0b9a20403cba302f7dec567f90 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:51.001871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d36669-d60f-4ac3-a1b2-f30642c2b28d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:51.102186 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d36669-d60f-4ac3-a1b2-f30642c2b28d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:51.136310 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b5e8a-addf-487a-b9fd-04c115d5a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:51.137174 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b5e8a-addf-487a-b9fd-04c115d5a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:51.137489 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b5e8a-addf-487a-b9fd-04c115d5a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:51.137765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b5e8a-addf-487a-b9fd-04c115d5a8e3 None admin] PATH_INFO: `/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:51.138995 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b5e8a-addf-487a-b9fd-04c115d5a8e3 None admin] RBAC: Authorizing `identity:get_project(project_id=4cb800d4dfd44d5f9cdcbf2af3964fb3)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:51.140444 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b5e8a-addf-487a-b9fd-04c115d5a8e3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:51.142187 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 555/1083] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:53:51 2022] GET /identity/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:51.148311 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a2e0d-be41-48b8-9e2d-e332fe891b1e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:51.251748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a2e0d-be41-48b8-9e2d-e332fe891b1e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:51.286115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4002aa-0b25-412e-8950-2659d2f5fc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:51.287017 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4002aa-0b25-412e-8950-2659d2f5fc94 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:51.287298 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4002aa-0b25-412e-8950-2659d2f5fc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:51.287568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4002aa-0b25-412e-8950-2659d2f5fc94 None admin] PATH_INFO: `/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3/users/3818ed0b9a20403cba302f7dec567f90/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:51.289556 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4002aa-0b25-412e-8950-2659d2f5fc94 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cb800d4dfd44d5f9cdcbf2af3964fb3, user_id=3818ed0b9a20403cba302f7dec567f90, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:51.291067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4002aa-0b25-412e-8950-2659d2f5fc94 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:51.304827 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 529/1084] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:53:51 2022] PUT /identity/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3/users/3818ed0b9a20403cba302f7dec567f90/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:53:52.316697 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed51d79-ab3a-4c31-9a64-5ba28944627c None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.317314 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed51d79-ab3a-4c31-9a64-5ba28944627c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.317707 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed51d79-ab3a-4c31-9a64-5ba28944627c None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.320031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 556/1085] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:52.325596 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867276b-c52d-4eb0-a35b-2e55d7620f14 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.326025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867276b-c52d-4eb0-a35b-2e55d7620f14 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.326299 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867276b-c52d-4eb0-a35b-2e55d7620f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.344052 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2867276b-c52d-4eb0-a35b-2e55d7620f14 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:52.345271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2867276b-c52d-4eb0-a35b-2e55d7620f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:52.347314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:52.418583 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 530/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:52.442096 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed51d79-ab3a-4c31-9a64-5ba28944627c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:52.512837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:52.549592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed51d79-ab3a-4c31-9a64-5ba28944627c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:52.586785 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a2eb3-f2f1-4b10-94d8-aced55283b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:52.587634 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a2eb3-f2f1-4b10-94d8-aced55283b00 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.587911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a2eb3-f2f1-4b10-94d8-aced55283b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.588180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a2eb3-f2f1-4b10-94d8-aced55283b00 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.598383 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a2eb3-f2f1-4b10-94d8-aced55283b00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-5b0a2eb3-f2f1-4b10-94d8-aced55283b00 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:52.606638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:52.607765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:52.608992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 557/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Sun Jul 24 00:53:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:52.614073 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867276b-c52d-4eb0-a35b-2e55d7620f14 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:52.712187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867276b-c52d-4eb0-a35b-2e55d7620f14 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:52.749397 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ef683-faff-4d5b-ad2d-1a85a753fc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:52.750071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ef683-faff-4d5b-ad2d-1a85a753fc81 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.750352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ef683-faff-4d5b-ad2d-1a85a753fc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.750620 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ef683-faff-4d5b-ad2d-1a85a753fc81 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.751373 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ef683-faff-4d5b-ad2d-1a85a753fc81 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:52.751681 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ef683-faff-4d5b-ad2d-1a85a753fc81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:52.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ef683-faff-4d5b-ad2d-1a85a753fc81 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:52.758322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:52.762145 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 531/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Jul 24 00:53:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:52.767959 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a2eb3-f2f1-4b10-94d8-aced55283b00 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:52.870925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a2eb3-f2f1-4b10-94d8-aced55283b00 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:52.897069 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:52.906061 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f9abe-1d6b-4253-a2c6-1acbf2be782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:52.906864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f9abe-1d6b-4253-a2c6-1acbf2be782c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.907145 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f9abe-1d6b-4253-a2c6-1acbf2be782c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.907416 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f9abe-1d6b-4253-a2c6-1acbf2be782c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.918321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f9abe-1d6b-4253-a2c6-1acbf2be782c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:52.919763 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f9abe-1d6b-4253-a2c6-1acbf2be782c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-358f9abe-1d6b-4253-a2c6-1acbf2be782c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:52.936716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:52.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:52.938593 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:52.938593 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:52.938593 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:52.938593 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:52.938593 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 558/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:52.943892 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ef683-faff-4d5b-ad2d-1a85a753fc81 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.044996 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ef683-faff-4d5b-ad2d-1a85a753fc81 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:53.080628 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93762728-78a2-4ca8-a623-9d80f15b7277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:53.081670 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762728-78a2-4ca8-a623-9d80f15b7277 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.081965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762728-78a2-4ca8-a623-9d80f15b7277 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.082247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762728-78a2-4ca8-a623-9d80f15b7277 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.082975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93762728-78a2-4ca8-a623-9d80f15b7277 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:53.083281 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93762728-78a2-4ca8-a623-9d80f15b7277 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:53.084671 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93762728-78a2-4ca8-a623-9d80f15b7277 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:53.097441 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 532/1090] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:53.103275 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f9abe-1d6b-4253-a2c6-1acbf2be782c None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.209424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f9abe-1d6b-4253-a2c6-1acbf2be782c None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:53.244099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff2b72-59ad-45c2-a79d-7fc2a803590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:53.244899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff2b72-59ad-45c2-a79d-7fc2a803590c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.245180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff2b72-59ad-45c2-a79d-7fc2a803590c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.245485 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff2b72-59ad-45c2-a79d-7fc2a803590c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.253113 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff2b72-59ad-45c2-a79d-7fc2a803590c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:53.254590 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff2b72-59ad-45c2-a79d-7fc2a803590c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-2eff2b72-59ad-45c2-a79d-7fc2a803590c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:53.268751 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:53.269777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:53.270761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:53.270761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:53.270761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:53.270761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:53.270761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:53.270761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:53.270761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:53.270761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:53.270761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:53.270761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:53.270761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 559/1091] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Jul 24 00:53:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:53.276221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93762728-78a2-4ca8-a623-9d80f15b7277 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.287097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5d2de-6d71-4b5c-864e-b0926e1a9f21 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.287381 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5d2de-6d71-4b5c-864e-b0926e1a9f21 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.287632 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5d2de-6d71-4b5c-864e-b0926e1a9f21 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.289024 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 560/1092] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:53.293944 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27de2e-9377-45fb-b7f7-5a00a90f824e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.294223 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27de2e-9377-45fb-b7f7-5a00a90f824e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.294495 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27de2e-9377-45fb-b7f7-5a00a90f824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.310667 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6d27de2e-9377-45fb-b7f7-5a00a90f824e None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:53.311848 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6d27de2e-9377-45fb-b7f7-5a00a90f824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:53.338864 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:53.346745 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:53.380377 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 561/1093] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:53.383178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93762728-78a2-4ca8-a623-9d80f15b7277 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:53.403750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27de2e-9377-45fb-b7f7-5a00a90f824e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.417233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd8416-b595-45c0-a6de-d52fc8b293fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:53.417906 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd8416-b595-45c0-a6de-d52fc8b293fb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.418181 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd8416-b595-45c0-a6de-d52fc8b293fb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.418448 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd8416-b595-45c0-a6de-d52fc8b293fb None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.419347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd8416-b595-45c0-a6de-d52fc8b293fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:53.419594 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd8416-b595-45c0-a6de-d52fc8b293fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:53.421046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd8416-b595-45c0-a6de-d52fc8b293fb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:53.437865 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 533/1094] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Jul 24 00:53:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:53.443640 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd8416-b595-45c0-a6de-d52fc8b293fb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.506699 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27de2e-9377-45fb-b7f7-5a00a90f824e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:53.540509 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd8416-b595-45c0-a6de-d52fc8b293fb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:53.541499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81c11b-ad05-4988-b4ae-45b681567498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:53.542314 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81c11b-ad05-4988-b4ae-45b681567498 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.542595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81c11b-ad05-4988-b4ae-45b681567498 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.542877 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81c11b-ad05-4988-b4ae-45b681567498 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.552977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81c11b-ad05-4988-b4ae-45b681567498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:53.557340 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-cf81c11b-ad05-4988-b4ae-45b681567498 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:53.560917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:53.561969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:53:53.562867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 562/1095] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:53.568156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81c11b-ad05-4988-b4ae-45b681567498 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.584499 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f56715-fc38-4623-9001-fbae1781cfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:53.585175 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f56715-fc38-4623-9001-fbae1781cfdf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.585495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f56715-fc38-4623-9001-fbae1781cfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.585767 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f56715-fc38-4623-9001-fbae1781cfdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.599358 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:53.656164 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f56715-fc38-4623-9001-fbae1781cfdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:53.657679 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f56715-fc38-4623-9001-fbae1781cfdf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:53.675434 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81c11b-ad05-4988-b4ae-45b681567498 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:53.711942 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272134c-1dab-481d-b648-e6dc70d3fa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:53.712664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272134c-1dab-481d-b648-e6dc70d3fa58 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.712943 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272134c-1dab-481d-b648-e6dc70d3fa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.713239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272134c-1dab-481d-b648-e6dc70d3fa58 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.713992 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272134c-1dab-481d-b648-e6dc70d3fa58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:53.714294 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272134c-1dab-481d-b648-e6dc70d3fa58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:53.715668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272134c-1dab-481d-b648-e6dc70d3fa58 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:53.726144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 563/1096] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:53.731980 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272134c-1dab-481d-b648-e6dc70d3fa58 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.768719 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 534/1097] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:53.774400 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f56715-fc38-4623-9001-fbae1781cfdf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.792693 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:53.824937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:53.835564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272134c-1dab-481d-b648-e6dc70d3fa58 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:53.870025 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9728-b755-4848-b913-154b0ec10826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:53.870908 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9728-b755-4848-b913-154b0ec10826 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.871190 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9728-b755-4848-b913-154b0ec10826 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.871463 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9728-b755-4848-b913-154b0ec10826 None admin] PATH_INFO: `/v3/users/3818ed0b9a20403cba302f7dec567f90` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.872668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9728-b755-4848-b913-154b0ec10826 None admin] RBAC: Authorizing `identity:get_user(user_id=3818ed0b9a20403cba302f7dec567f90)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:53.872997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f56715-fc38-4623-9001-fbae1781cfdf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:53.874136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9728-b755-4848-b913-154b0ec10826 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:53.875897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 564/1098] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:53:53 2022] GET /identity/v3/users/3818ed0b9a20403cba302f7dec567f90 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:53.881616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9728-b755-4848-b913-154b0ec10826 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.906122 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71003c-71d6-4dec-87e1-9ae3c9bb3e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:53.906918 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71003c-71d6-4dec-87e1-9ae3c9bb3e01 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.907196 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71003c-71d6-4dec-87e1-9ae3c9bb3e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.907467 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71003c-71d6-4dec-87e1-9ae3c9bb3e01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.917992 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71003c-71d6-4dec-87e1-9ae3c9bb3e01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:53.919447 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71003c-71d6-4dec-87e1-9ae3c9bb3e01 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-cf71003c-71d6-4dec-87e1-9ae3c9bb3e01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:53.936871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:53.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:53.938817 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:53.938817 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:53.938817 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:53.938817 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:53.938817 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 535/1099] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:53.943839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71003c-71d6-4dec-87e1-9ae3c9bb3e01 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.982129 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9728-b755-4848-b913-154b0ec10826 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:54.018873 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49630ccf-4069-4d75-82e0-183d66ddee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:54.018873 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630ccf-4069-4d75-82e0-183d66ddee64 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:54.018873 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630ccf-4069-4d75-82e0-183d66ddee64 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:54.018873 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630ccf-4069-4d75-82e0-183d66ddee64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:54.027774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:54.050129 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:54.058959 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71003c-71d6-4dec-87e1-9ae3c9bb3e01 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:54.091384 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49630ccf-4069-4d75-82e0-183d66ddee64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:54.092853 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49630ccf-4069-4d75-82e0-183d66ddee64 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:54.093675 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b023783-64e2-42dd-8b16-6ba5e4a98460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:54.094350 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b023783-64e2-42dd-8b16-6ba5e4a98460 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:54.094633 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b023783-64e2-42dd-8b16-6ba5e4a98460 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:54.094910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b023783-64e2-42dd-8b16-6ba5e4a98460 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:54.095607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b023783-64e2-42dd-8b16-6ba5e4a98460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:54.095913 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b023783-64e2-42dd-8b16-6ba5e4a98460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:54.097309 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b023783-64e2-42dd-8b16-6ba5e4a98460 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:54.108805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 536/1100] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:54.114472 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b023783-64e2-42dd-8b16-6ba5e4a98460 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:54.191283 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 565/1101] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:53:54.197302 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49630ccf-4069-4d75-82e0-183d66ddee64 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:54.212345 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b023783-64e2-42dd-8b16-6ba5e4a98460 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:54.240079 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:54.246383 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade8a9d-427b-457f-808e-a44e4d8811d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:54.247190 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade8a9d-427b-457f-808e-a44e4d8811d5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:54.247474 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade8a9d-427b-457f-808e-a44e4d8811d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:54.247752 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade8a9d-427b-457f-808e-a44e4d8811d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:54.254457 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade8a9d-427b-457f-808e-a44e4d8811d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:54.255796 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:54.255922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade8a9d-427b-457f-808e-a44e4d8811d5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-dade8a9d-427b-457f-808e-a44e4d8811d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:54.270302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:54.271278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:54.272185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:54.272185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:54.272185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:54.272185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:54.272185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:54.272185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:54.272185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:54.272185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:53:54.272185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 537/1102] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:54.277574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade8a9d-427b-457f-808e-a44e4d8811d5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:54.297450 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49630ccf-4069-4d75-82e0-183d66ddee64 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:54.332259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b222cd-bdce-4d10-8233-256248b59a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:54.333127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b222cd-bdce-4d10-8233-256248b59a23 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:54.333433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b222cd-bdce-4d10-8233-256248b59a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:54.333685 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b222cd-bdce-4d10-8233-256248b59a23 None admin] PATH_INFO: `/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:54.334868 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b222cd-bdce-4d10-8233-256248b59a23 None admin] RBAC: Authorizing `identity:get_project(project_id=4cb800d4dfd44d5f9cdcbf2af3964fb3)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:54.336327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b222cd-bdce-4d10-8233-256248b59a23 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:54.338255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 566/1103] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:53:54 2022] GET /identity/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:54.344296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b222cd-bdce-4d10-8233-256248b59a23 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:54.378986 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade8a9d-427b-457f-808e-a44e4d8811d5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:54.412421 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a098c71-62f0-4832-81c7-20fa06b992d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:54.413079 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a098c71-62f0-4832-81c7-20fa06b992d9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:54.413387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a098c71-62f0-4832-81c7-20fa06b992d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:54.413658 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a098c71-62f0-4832-81c7-20fa06b992d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:54.414442 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a098c71-62f0-4832-81c7-20fa06b992d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:54.414747 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a098c71-62f0-4832-81c7-20fa06b992d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:54.416275 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a098c71-62f0-4832-81c7-20fa06b992d9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:54.427623 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 538/1104] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:54.433741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a098c71-62f0-4832-81c7-20fa06b992d9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:54.447343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b222cd-bdce-4d10-8233-256248b59a23 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:54.473488 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:54.481504 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95ca75-b536-4ea6-81f8-bc10b83aaf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:54.482160 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95ca75-b536-4ea6-81f8-bc10b83aaf27 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:54.482440 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95ca75-b536-4ea6-81f8-bc10b83aaf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:54.482561 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:54.482713 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95ca75-b536-4ea6-81f8-bc10b83aaf27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:54.483569 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95ca75-b536-4ea6-81f8-bc10b83aaf27 None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=4cb800d4dfd44d5f9cdcbf2af3964fb3, user.id=3818ed0b9a20403cba302f7dec567f90) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:54.483847 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95ca75-b536-4ea6-81f8-bc10b83aaf27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:54.485362 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95ca75-b536-4ea6-81f8-bc10b83aaf27 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:54.491541 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 567/1105] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:54 2022] GET /identity/v3/role_assignments?user.id=3818ed0b9a20403cba302f7dec567f90&scope.project.id=4cb800d4dfd44d5f9cdcbf2af3964fb3&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:54.534880 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a098c71-62f0-4832-81c7-20fa06b992d9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:54.572663 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61a13f-923c-48ae-8449-55780761d0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:54.573393 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61a13f-923c-48ae-8449-55780761d0dd None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:54.573676 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61a13f-923c-48ae-8449-55780761d0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:54.573951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61a13f-923c-48ae-8449-55780761d0dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:54.574834 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61a13f-923c-48ae-8449-55780761d0dd None admin] RBAC: Adding query filter params (role.id=bf43109eef0844758450a191d35cf485, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=808b08d1d2df42e587279071a5dba593) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:54.575149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61a13f-923c-48ae-8449-55780761d0dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:54.576620 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61a13f-923c-48ae-8449-55780761d0dd None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:54.584687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 539/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:54 2022] GET /identity/v3/role_assignments?user.id=808b08d1d2df42e587279071a5dba593&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=bf43109eef0844758450a191d35cf485 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:56.543281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ad65f-a26b-4970-a568-b1ed0635f15e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.544211 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ad65f-a26b-4970-a568-b1ed0635f15e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.544211 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ad65f-a26b-4970-a568-b1ed0635f15e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.546627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 568/1107] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:56.552909 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3958f16-03db-43e2-9e55-1c04695ff405 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.553661 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3958f16-03db-43e2-9e55-1c04695ff405 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.553818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3958f16-03db-43e2-9e55-1c04695ff405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.578124 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a3958f16-03db-43e2-9e55-1c04695ff405 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:56.579357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a3958f16-03db-43e2-9e55-1c04695ff405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:56.653096 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 540/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:56.678578 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ad65f-a26b-4970-a568-b1ed0635f15e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:56.792154 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ad65f-a26b-4970-a568-b1ed0635f15e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:56.827010 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89825e-79b5-48f3-9ce5-7f1ef3507a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:56.827730 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89825e-79b5-48f3-9ce5-7f1ef3507a77 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.828007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89825e-79b5-48f3-9ce5-7f1ef3507a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.828275 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89825e-79b5-48f3-9ce5-7f1ef3507a77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.829577 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89825e-79b5-48f3-9ce5-7f1ef3507a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:56.831009 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89825e-79b5-48f3-9ce5-7f1ef3507a77 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:56.832973 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 569/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:56.840791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3958f16-03db-43e2-9e55-1c04695ff405 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:56.889388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:56.949602 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3958f16-03db-43e2-9e55-1c04695ff405 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:56.991899 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cbfe7-0223-4e30-9dc8-5f8b4ed04453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:56.992859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cbfe7-0223-4e30-9dc8-5f8b4ed04453 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.993285 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cbfe7-0223-4e30-9dc8-5f8b4ed04453 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.993643 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cbfe7-0223-4e30-9dc8-5f8b4ed04453 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.994713 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cbfe7-0223-4e30-9dc8-5f8b4ed04453 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:56.996951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cbfe7-0223-4e30-9dc8-5f8b4ed04453 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:57.027341 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 541/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:53:56 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:59.079872 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93a37f-decb-416d-af4d-b539408ac0f8 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:59.080805 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93a37f-decb-416d-af4d-b539408ac0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:59.080805 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93a37f-decb-416d-af4d-b539408ac0f8 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:59.083513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 570/1111] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:53:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:59.094584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70708a3a-9649-4ef0-90dd-6d71f8ab598c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:59.095040 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70708a3a-9649-4ef0-90dd-6d71f8ab598c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:59.095158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70708a3a-9649-4ef0-90dd-6d71f8ab598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:59.125641 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-70708a3a-9649-4ef0-90dd-6d71f8ab598c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:59.126848 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-70708a3a-9649-4ef0-90dd-6d71f8ab598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:59.205140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 542/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:59.229707 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93a37f-decb-416d-af4d-b539408ac0f8 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:59.305626 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:59.353747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93a37f-decb-416d-af4d-b539408ac0f8 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:59.389439 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea8145-b305-4b49-ae4b-6352f03e6a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:59.390287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea8145-b305-4b49-ae4b-6352f03e6a22 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:59.390569 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea8145-b305-4b49-ae4b-6352f03e6a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:59.390842 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea8145-b305-4b49-ae4b-6352f03e6a22 None admin] PATH_INFO: `/v3/roles/d91e55b589bd4b9aaab2ab607f087f8d` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:59.392438 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea8145-b305-4b49-ae4b-6352f03e6a22 None admin] RBAC: Authorizing `identity:get_role(role_id=d91e55b589bd4b9aaab2ab607f087f8d)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:59.393848 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea8145-b305-4b49-ae4b-6352f03e6a22 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:59.395207 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 571/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:53:59 2022] GET /identity/v3/roles/d91e55b589bd4b9aaab2ab607f087f8d => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:59.404641 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70708a3a-9649-4ef0-90dd-6d71f8ab598c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:59.441274 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:59.525129 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70708a3a-9649-4ef0-90dd-6d71f8ab598c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:59.563742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09017f-afeb-44c9-827d-9cbdefad2415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:59.564618 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09017f-afeb-44c9-827d-9cbdefad2415 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:59.564900 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09017f-afeb-44c9-827d-9cbdefad2415 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:59.565168 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09017f-afeb-44c9-827d-9cbdefad2415 None admin] PATH_INFO: `/v3/users/9912b495acc1470b8a086f7a23f4a5c1` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:59.579187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09017f-afeb-44c9-827d-9cbdefad2415 None admin] RBAC: Authorizing `identity:get_user(user_id=9912b495acc1470b8a086f7a23f4a5c1)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:59.580664 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09017f-afeb-44c9-827d-9cbdefad2415 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:59.582780 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 543/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:53:59 2022] GET /identity/v3/users/9912b495acc1470b8a086f7a23f4a5c1 => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:59.589183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea8145-b305-4b49-ae4b-6352f03e6a22 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:59.692884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea8145-b305-4b49-ae4b-6352f03e6a22 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:59.724386 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:59.733343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02584a43-de08-4914-8e2d-bf588fef4232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:59.734002 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02584a43-de08-4914-8e2d-bf588fef4232 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:59.734282 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02584a43-de08-4914-8e2d-bf588fef4232 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:59.734552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02584a43-de08-4914-8e2d-bf588fef4232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:59.803020 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02584a43-de08-4914-8e2d-bf588fef4232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:59.804458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02584a43-de08-4914-8e2d-bf588fef4232 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:59.917364 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 572/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:59.926441 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09017f-afeb-44c9-827d-9cbdefad2415 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:00.018187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:00.031440 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09017f-afeb-44c9-827d-9cbdefad2415 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:00.066241 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdf77d-2c21-423f-86eb-bff5e0f934b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:00.068036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdf77d-2c21-423f-86eb-bff5e0f934b9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:00.068036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdf77d-2c21-423f-86eb-bff5e0f934b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:00.068036 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdf77d-2c21-423f-86eb-bff5e0f934b9 None admin] PATH_INFO: `/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:00.069003 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdf77d-2c21-423f-86eb-bff5e0f934b9 None admin] RBAC: Authorizing `identity:get_project(project_id=4cb800d4dfd44d5f9cdcbf2af3964fb3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:00.070511 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdf77d-2c21-423f-86eb-bff5e0f934b9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:00.072265 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 544/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:53:59 2022] GET /identity/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:00.078547 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02584a43-de08-4914-8e2d-bf588fef4232 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:00.106949 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:00.178621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02584a43-de08-4914-8e2d-bf588fef4232 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:00.220848 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e050550-ca3c-4ab5-afbc-b333928dd35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:00.221835 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e050550-ca3c-4ab5-afbc-b333928dd35e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:00.222178 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e050550-ca3c-4ab5-afbc-b333928dd35e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:00.222527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e050550-ca3c-4ab5-afbc-b333928dd35e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:00.223825 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e050550-ca3c-4ab5-afbc-b333928dd35e None admin] RBAC: Adding query filter params (role.id=d91e55b589bd4b9aaab2ab607f087f8d, scope.project.id=4cb800d4dfd44d5f9cdcbf2af3964fb3, user.id=9912b495acc1470b8a086f7a23f4a5c1) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:00.224231 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e050550-ca3c-4ab5-afbc-b333928dd35e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:00.226516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e050550-ca3c-4ab5-afbc-b333928dd35e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:00.233602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 573/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:00 2022] GET /identity/v3/role_assignments?user.id=9912b495acc1470b8a086f7a23f4a5c1&scope.project.id=4cb800d4dfd44d5f9cdcbf2af3964fb3&role.id=d91e55b589bd4b9aaab2ab607f087f8d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:02.246698 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ba1da-3eb7-4ea6-a66a-5df23d58a63c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:02.247588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ba1da-3eb7-4ea6-a66a-5df23d58a63c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:02.247588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ba1da-3eb7-4ea6-a66a-5df23d58a63c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:02.249808 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 545/1118] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:02.258833 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcda700-5782-4c12-897d-b010413886c4 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:02.259249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcda700-5782-4c12-897d-b010413886c4 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:02.259424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcda700-5782-4c12-897d-b010413886c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:02.277904 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3fcda700-5782-4c12-897d-b010413886c4 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:02.279109 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3fcda700-5782-4c12-897d-b010413886c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:02.349517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 574/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:02.372619 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ba1da-3eb7-4ea6-a66a-5df23d58a63c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:02.484330 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ba1da-3eb7-4ea6-a66a-5df23d58a63c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:02.518743 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fcb8e-eeae-4a78-b24f-74849d051614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:02.519537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fcb8e-eeae-4a78-b24f-74849d051614 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:02.519805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fcb8e-eeae-4a78-b24f-74849d051614 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:02.520071 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fcb8e-eeae-4a78-b24f-74849d051614 None admin] PATH_INFO: `/v3/roles/d91e55b589bd4b9aaab2ab607f087f8d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:02.521688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fcb8e-eeae-4a78-b24f-74849d051614 None admin] RBAC: Authorizing `identity:get_role(role_id=d91e55b589bd4b9aaab2ab607f087f8d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:02.523060 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fcb8e-eeae-4a78-b24f-74849d051614 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:02.524394 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 546/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:02 2022] GET /identity/v3/roles/d91e55b589bd4b9aaab2ab607f087f8d => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:02.533965 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcda700-5782-4c12-897d-b010413886c4 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:02.576401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:02.661315 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcda700-5782-4c12-897d-b010413886c4 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:02.696852 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00501d-f11b-4382-b26e-33573571c1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:02.697755 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00501d-f11b-4382-b26e-33573571c1fb None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:02.698039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00501d-f11b-4382-b26e-33573571c1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:02.698306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00501d-f11b-4382-b26e-33573571c1fb None admin] PATH_INFO: `/v3/users/9912b495acc1470b8a086f7a23f4a5c1` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:02.699600 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00501d-f11b-4382-b26e-33573571c1fb None admin] RBAC: Authorizing `identity:get_user(user_id=9912b495acc1470b8a086f7a23f4a5c1)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:02.701038 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00501d-f11b-4382-b26e-33573571c1fb None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:02.702686 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 575/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:02 2022] GET /identity/v3/users/9912b495acc1470b8a086f7a23f4a5c1 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:02.710275 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fcb8e-eeae-4a78-b24f-74849d051614 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:02.742588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:02.819683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fcb8e-eeae-4a78-b24f-74849d051614 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:02.855737 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb11fc1-ea67-4f4c-9fe5-28baeddb0425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:02.856601 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11fc1-ea67-4f4c-9fe5-28baeddb0425 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:02.856883 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11fc1-ea67-4f4c-9fe5-28baeddb0425 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:02.857128 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11fc1-ea67-4f4c-9fe5-28baeddb0425 None admin] PATH_INFO: `/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:02.858444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb11fc1-ea67-4f4c-9fe5-28baeddb0425 None admin] RBAC: Authorizing `identity:get_project(project_id=4cb800d4dfd44d5f9cdcbf2af3964fb3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:02.859916 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb11fc1-ea67-4f4c-9fe5-28baeddb0425 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:02.861661 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 547/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:02 2022] GET /identity/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:02.868098 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00501d-f11b-4382-b26e-33573571c1fb None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:02.964716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:02.980627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00501d-f11b-4382-b26e-33573571c1fb None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:03.017120 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b04c2-301c-427e-90c3-f7716cf2d0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:03.018035 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b04c2-301c-427e-90c3-f7716cf2d0a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:03.018321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b04c2-301c-427e-90c3-f7716cf2d0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:03.018598 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b04c2-301c-427e-90c3-f7716cf2d0a3 None admin] PATH_INFO: `/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3/users/9912b495acc1470b8a086f7a23f4a5c1/roles/d91e55b589bd4b9aaab2ab607f087f8d` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:03.020824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b04c2-301c-427e-90c3-f7716cf2d0a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cb800d4dfd44d5f9cdcbf2af3964fb3, user_id=9912b495acc1470b8a086f7a23f4a5c1, role_id=d91e55b589bd4b9aaab2ab607f087f8d)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:03.022308 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b04c2-301c-427e-90c3-f7716cf2d0a3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:03.043518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 576/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:54:02 2022] PUT /identity/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3/users/9912b495acc1470b8a086f7a23f4a5c1/roles/d91e55b589bd4b9aaab2ab607f087f8d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:54:05.053292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b060226-ddfa-4e7f-bba8-1999d4ff3e60 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:05.053893 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b060226-ddfa-4e7f-bba8-1999d4ff3e60 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:05.053893 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b060226-ddfa-4e7f-bba8-1999d4ff3e60 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:05.055971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 548/1124] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:05.062665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de2f81-71d3-4ece-a5bf-b731d715518f None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:05.063125 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de2f81-71d3-4ece-a5bf-b731d715518f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:05.063232 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de2f81-71d3-4ece-a5bf-b731d715518f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:05.081403 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d6de2f81-71d3-4ece-a5bf-b731d715518f None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:05.082582 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d6de2f81-71d3-4ece-a5bf-b731d715518f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:05.151644 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 577/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:54:05.175077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b060226-ddfa-4e7f-bba8-1999d4ff3e60 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:05.277070 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:05.289061 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b060226-ddfa-4e7f-bba8-1999d4ff3e60 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:05.323916 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4e3cd-8d6f-42f7-b9ad-5b12c853c600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:05.324743 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4e3cd-8d6f-42f7-b9ad-5b12c853c600 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:05.325022 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4e3cd-8d6f-42f7-b9ad-5b12c853c600 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:05.325314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4e3cd-8d6f-42f7-b9ad-5b12c853c600 None admin] PATH_INFO: `/v3/roles/d91e55b589bd4b9aaab2ab607f087f8d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:05.326801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4e3cd-8d6f-42f7-b9ad-5b12c853c600 None admin] RBAC: Authorizing `identity:get_role(role_id=d91e55b589bd4b9aaab2ab607f087f8d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:05.328180 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4e3cd-8d6f-42f7-b9ad-5b12c853c600 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:05.329567 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 549/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:05 2022] GET /identity/v3/roles/d91e55b589bd4b9aaab2ab607f087f8d => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:05.336437 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de2f81-71d3-4ece-a5bf-b731d715518f None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:05.435878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:05.457525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de2f81-71d3-4ece-a5bf-b731d715518f None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:05.497739 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d87b2-add9-4425-a3e5-5aff639b15cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:05.498605 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d87b2-add9-4425-a3e5-5aff639b15cc None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:05.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d87b2-add9-4425-a3e5-5aff639b15cc None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:05.499155 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d87b2-add9-4425-a3e5-5aff639b15cc None admin] PATH_INFO: `/v3/users/9912b495acc1470b8a086f7a23f4a5c1` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:05.500460 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d87b2-add9-4425-a3e5-5aff639b15cc None admin] RBAC: Authorizing `identity:get_user(user_id=9912b495acc1470b8a086f7a23f4a5c1)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:05.501926 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d87b2-add9-4425-a3e5-5aff639b15cc None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:05.503540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 578/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:05 2022] GET /identity/v3/users/9912b495acc1470b8a086f7a23f4a5c1 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:05.509326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4e3cd-8d6f-42f7-b9ad-5b12c853c600 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:05.617487 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4e3cd-8d6f-42f7-b9ad-5b12c853c600 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:05.652606 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cd7b3-1e73-4897-b354-54e440d0a832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:05.653242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cd7b3-1e73-4897-b354-54e440d0a832 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:05.653549 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cd7b3-1e73-4897-b354-54e440d0a832 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:05.653816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cd7b3-1e73-4897-b354-54e440d0a832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:05.681703 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:05.724216 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cd7b3-1e73-4897-b354-54e440d0a832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:05.725699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cd7b3-1e73-4897-b354-54e440d0a832 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:05.833380 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 550/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:54:05.839743 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d87b2-add9-4425-a3e5-5aff639b15cc None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:05.941703 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d87b2-add9-4425-a3e5-5aff639b15cc None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:05.976815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32da64-294e-464d-baf5-de7dc118c14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:05.977692 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32da64-294e-464d-baf5-de7dc118c14c None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:05.977970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32da64-294e-464d-baf5-de7dc118c14c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:05.978237 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32da64-294e-464d-baf5-de7dc118c14c None admin] PATH_INFO: `/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:05.979534 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32da64-294e-464d-baf5-de7dc118c14c None admin] RBAC: Authorizing `identity:get_project(project_id=4cb800d4dfd44d5f9cdcbf2af3964fb3)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:05.981000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32da64-294e-464d-baf5-de7dc118c14c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:05.982721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 579/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:05 2022] GET /identity/v3/projects/4cb800d4dfd44d5f9cdcbf2af3964fb3 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:05.989706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cd7b3-1e73-4897-b354-54e440d0a832 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:06.061648 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:06.104066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cd7b3-1e73-4897-b354-54e440d0a832 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:06.138931 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f7cc2-e127-4e48-a56a-c504b07c5800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:06.139579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f7cc2-e127-4e48-a56a-c504b07c5800 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:06.139856 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f7cc2-e127-4e48-a56a-c504b07c5800 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:06.140125 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f7cc2-e127-4e48-a56a-c504b07c5800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:06.140958 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f7cc2-e127-4e48-a56a-c504b07c5800 None admin] RBAC: Adding query filter params (role.id=d91e55b589bd4b9aaab2ab607f087f8d, scope.project.id=4cb800d4dfd44d5f9cdcbf2af3964fb3, user.id=9912b495acc1470b8a086f7a23f4a5c1) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:06.141300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f7cc2-e127-4e48-a56a-c504b07c5800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:06.142733 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f7cc2-e127-4e48-a56a-c504b07c5800 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:06.148701 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 551/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:05 2022] GET /identity/v3/role_assignments?user.id=9912b495acc1470b8a086f7a23f4a5c1&scope.project.id=4cb800d4dfd44d5f9cdcbf2af3964fb3&role.id=d91e55b589bd4b9aaab2ab607f087f8d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:08.167133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd49656-26e8-40d6-9032-8ab30f5457f1 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:08.168090 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd49656-26e8-40d6-9032-8ab30f5457f1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:08.168090 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd49656-26e8-40d6-9032-8ab30f5457f1 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:08.170436 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 580/1131] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:08.175837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d346b2e-87c2-4726-b895-32aa6949b598 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:08.176278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d346b2e-87c2-4726-b895-32aa6949b598 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:08.176381 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d346b2e-87c2-4726-b895-32aa6949b598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:08.194838 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5d346b2e-87c2-4726-b895-32aa6949b598 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:08.196007 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5d346b2e-87c2-4726-b895-32aa6949b598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:08.264277 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 552/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:08.287813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd49656-26e8-40d6-9032-8ab30f5457f1 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:08.308517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:08.410932 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd49656-26e8-40d6-9032-8ab30f5457f1 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:08.447512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a9153-7a03-48d4-981a-98baf31be89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:08.448254 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a9153-7a03-48d4-981a-98baf31be89f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:08.448537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a9153-7a03-48d4-981a-98baf31be89f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:08.448807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a9153-7a03-48d4-981a-98baf31be89f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:08.450366 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a9153-7a03-48d4-981a-98baf31be89f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:08.451835 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a9153-7a03-48d4-981a-98baf31be89f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:08.453523 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 581/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:54:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:08.460252 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d346b2e-87c2-4726-b895-32aa6949b598 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:08.519466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:08.578070 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d346b2e-87c2-4726-b895-32aa6949b598 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:08.613621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ada54-883e-45a1-9121-4b1ff73f10b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:08.614287 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ada54-883e-45a1-9121-4b1ff73f10b4 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:08.614569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ada54-883e-45a1-9121-4b1ff73f10b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:08.614842 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ada54-883e-45a1-9121-4b1ff73f10b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:08.615555 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ada54-883e-45a1-9121-4b1ff73f10b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:08.617000 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ada54-883e-45a1-9121-4b1ff73f10b4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:08.643765 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 553/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:54:08 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:54:10.686386 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610456ea-b1f0-4a5c-8461-1b997761781e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:10.687255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610456ea-b1f0-4a5c-8461-1b997761781e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:10.687255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610456ea-b1f0-4a5c-8461-1b997761781e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:10.689561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 582/1135] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:10.695951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f91bb-e788-4a45-ab83-630bfd5ff8bd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:10.696616 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f91bb-e788-4a45-ab83-630bfd5ff8bd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:10.696825 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f91bb-e788-4a45-ab83-630bfd5ff8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:10.717764 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c06f91bb-e788-4a45-ab83-630bfd5ff8bd None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:10.718961 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c06f91bb-e788-4a45-ab83-630bfd5ff8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:10.787974 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 554/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:10.820662 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610456ea-b1f0-4a5c-8461-1b997761781e None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:10.915270 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:10.935943 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610456ea-b1f0-4a5c-8461-1b997761781e None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:10.972931 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15e8de-6796-4301-b8d5-c61db518e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:10.973772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15e8de-6796-4301-b8d5-c61db518e349 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:10.974055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15e8de-6796-4301-b8d5-c61db518e349 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:10.974329 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15e8de-6796-4301-b8d5-c61db518e349 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:10.975641 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15e8de-6796-4301-b8d5-c61db518e349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:10.977104 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15e8de-6796-4301-b8d5-c61db518e349 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:10.978788 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 583/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:54:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:10.984949 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f91bb-e788-4a45-ab83-630bfd5ff8bd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:11.020331 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:11.090688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f91bb-e788-4a45-ab83-630bfd5ff8bd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:11.126085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6b1ea-11c0-4829-994b-c2fb21a18d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:11.126748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b1ea-11c0-4829-994b-c2fb21a18d8d None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:11.127029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b1ea-11c0-4829-994b-c2fb21a18d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:11.127301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b1ea-11c0-4829-994b-c2fb21a18d8d None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:11.128005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6b1ea-11c0-4829-994b-c2fb21a18d8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:11.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6b1ea-11c0-4829-994b-c2fb21a18d8d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:11.156157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 555/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:54:10 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:54:13.203821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e6bf3-0aea-43e1-baa3-c88f97f1f8a3 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:13.204673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e6bf3-0aea-43e1-baa3-c88f97f1f8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:13.204673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e6bf3-0aea-43e1-baa3-c88f97f1f8a3 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:13.207341 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 584/1139] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:13.213814 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dbd1f-a862-4236-b835-7681586a0eaa None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:13.214280 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dbd1f-a862-4236-b835-7681586a0eaa None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:13.214475 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dbd1f-a862-4236-b835-7681586a0eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:13.233616 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c79dbd1f-a862-4236-b835-7681586a0eaa None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:13.234806 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c79dbd1f-a862-4236-b835-7681586a0eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:13.310237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 556/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:13.341159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e6bf3-0aea-43e1-baa3-c88f97f1f8a3 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:13.443116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e6bf3-0aea-43e1-baa3-c88f97f1f8a3 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:13.478295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd115b-1060-4618-b81e-c7cf7c080463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:13.479002 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd115b-1060-4618-b81e-c7cf7c080463 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:13.479278 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd115b-1060-4618-b81e-c7cf7c080463 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:13.479546 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd115b-1060-4618-b81e-c7cf7c080463 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:13.489989 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd115b-1060-4618-b81e-c7cf7c080463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-36fd115b-1060-4618-b81e-c7cf7c080463 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:13.497573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:13.498721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:54:13.499981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 585/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:13.505358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dbd1f-a862-4236-b835-7681586a0eaa None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:13.531436 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:13.613185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dbd1f-a862-4236-b835-7681586a0eaa None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:13.655394 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31524e-a1eb-4508-a36a-c676ab5ba84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:13.656432 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31524e-a1eb-4508-a36a-c676ab5ba84e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:13.656801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31524e-a1eb-4508-a36a-c676ab5ba84e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:13.657178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31524e-a1eb-4508-a36a-c676ab5ba84e None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:13.658371 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31524e-a1eb-4508-a36a-c676ab5ba84e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:13.658779 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31524e-a1eb-4508-a36a-c676ab5ba84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:13.660946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31524e-a1eb-4508-a36a-c676ab5ba84e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:13.672065 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 557/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:13.678116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd115b-1060-4618-b81e-c7cf7c080463 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:13.694383 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:13.787920 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd115b-1060-4618-b81e-c7cf7c080463 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:13.821611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a5f3f-4d5c-409c-a93f-b34363505ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:13.822478 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a5f3f-4d5c-409c-a93f-b34363505ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:13.822759 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a5f3f-4d5c-409c-a93f-b34363505ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:13.823030 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a5f3f-4d5c-409c-a93f-b34363505ef4 None admin] PATH_INFO: `/v3/users/1f3b10cc801a4e79ba83970a55044fb1` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:13.836772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a5f3f-4d5c-409c-a93f-b34363505ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=1f3b10cc801a4e79ba83970a55044fb1)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:13.838244 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a5f3f-4d5c-409c-a93f-b34363505ef4 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:13.839947 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 586/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:13 2022] GET /identity/v3/users/1f3b10cc801a4e79ba83970a55044fb1 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:13.849377 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31524e-a1eb-4508-a36a-c676ab5ba84e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:13.944481 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:13.961981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31524e-a1eb-4508-a36a-c676ab5ba84e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:13.995999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31318839-61a4-4ed5-ae6e-52b8f6750507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:13.996669 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31318839-61a4-4ed5-ae6e-52b8f6750507 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:13.996955 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31318839-61a4-4ed5-ae6e-52b8f6750507 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:13.997240 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31318839-61a4-4ed5-ae6e-52b8f6750507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:14.066049 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31318839-61a4-4ed5-ae6e-52b8f6750507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:14.067439 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31318839-61a4-4ed5-ae6e-52b8f6750507 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:14.152231 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:14.172831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 558/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:54:14.180274 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a5f3f-4d5c-409c-a93f-b34363505ef4 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:14.255258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:14.300347 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a5f3f-4d5c-409c-a93f-b34363505ef4 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:14.337745 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42c2fb-3cf1-4f36-9f99-27715ab431b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:14.338540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42c2fb-3cf1-4f36-9f99-27715ab431b9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:14.338817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42c2fb-3cf1-4f36-9f99-27715ab431b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:14.339064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42c2fb-3cf1-4f36-9f99-27715ab431b9 None admin] PATH_INFO: `/v3/projects/433463b87740417484f1d2ebfe640777` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:14.340330 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42c2fb-3cf1-4f36-9f99-27715ab431b9 None admin] RBAC: Authorizing `identity:get_project(project_id=433463b87740417484f1d2ebfe640777)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:14.341819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42c2fb-3cf1-4f36-9f99-27715ab431b9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:14.343537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 587/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:14 2022] GET /identity/v3/projects/433463b87740417484f1d2ebfe640777 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:14.350644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31318839-61a4-4ed5-ae6e-52b8f6750507 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:14.456746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31318839-61a4-4ed5-ae6e-52b8f6750507 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:14.491872 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba35a8d-2519-414c-9fa9-d5862b351e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:14.492514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba35a8d-2519-414c-9fa9-d5862b351e5b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:14.492795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba35a8d-2519-414c-9fa9-d5862b351e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:14.493068 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba35a8d-2519-414c-9fa9-d5862b351e5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:14.493929 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba35a8d-2519-414c-9fa9-d5862b351e5b None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=433463b87740417484f1d2ebfe640777, user.id=1f3b10cc801a4e79ba83970a55044fb1) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:14.494241 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba35a8d-2519-414c-9fa9-d5862b351e5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:14.495794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba35a8d-2519-414c-9fa9-d5862b351e5b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:14.501351 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 559/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:14 2022] GET /identity/v3/role_assignments?user.id=1f3b10cc801a4e79ba83970a55044fb1&scope.project.id=433463b87740417484f1d2ebfe640777&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:16.455035 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ee242-0c03-4abc-ac8c-53d0acb97333 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:16.455991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ee242-0c03-4abc-ac8c-53d0acb97333 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:16.455991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ee242-0c03-4abc-ac8c-53d0acb97333 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:16.457365 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 588/1147] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:16.463532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cc9dd-1b47-44c4-8bcd-0856178c3fab None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:16.463958 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cc9dd-1b47-44c4-8bcd-0856178c3fab None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:16.464098 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cc9dd-1b47-44c4-8bcd-0856178c3fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:16.487494 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-294cc9dd-1b47-44c4-8bcd-0856178c3fab None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:16.488687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-294cc9dd-1b47-44c4-8bcd-0856178c3fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:16.543087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:16.569542 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 560/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:16.592943 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ee242-0c03-4abc-ac8c-53d0acb97333 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:16.702642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ee242-0c03-4abc-ac8c-53d0acb97333 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:16.737378 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3568bfe-36e5-4009-94aa-0ee19712986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:16.738094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3568bfe-36e5-4009-94aa-0ee19712986d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:16.738329 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3568bfe-36e5-4009-94aa-0ee19712986d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:16.738638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3568bfe-36e5-4009-94aa-0ee19712986d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:16.745953 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:16.751016 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3568bfe-36e5-4009-94aa-0ee19712986d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-b3568bfe-36e5-4009-94aa-0ee19712986d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:16.764886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:16.766015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:54:16.767159 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 589/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:16.774776 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cc9dd-1b47-44c4-8bcd-0856178c3fab None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:16.884788 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cc9dd-1b47-44c4-8bcd-0856178c3fab None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:16.920840 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc889bb8-06a5-4c4c-bfee-b86eecf02e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:16.921504 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889bb8-06a5-4c4c-bfee-b86eecf02e9e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:16.921812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889bb8-06a5-4c4c-bfee-b86eecf02e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:16.922084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889bb8-06a5-4c4c-bfee-b86eecf02e9e None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:16.922827 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc889bb8-06a5-4c4c-bfee-b86eecf02e9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:16.923122 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc889bb8-06a5-4c4c-bfee-b86eecf02e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:16.924607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc889bb8-06a5-4c4c-bfee-b86eecf02e9e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:16.933814 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 561/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:16.943137 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3568bfe-36e5-4009-94aa-0ee19712986d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:17.051966 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3568bfe-36e5-4009-94aa-0ee19712986d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:17.095141 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec9479-95cb-4cd0-b6ef-00e3fdcce7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:17.096018 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec9479-95cb-4cd0-b6ef-00e3fdcce7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:17.096304 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec9479-95cb-4cd0-b6ef-00e3fdcce7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:17.096635 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec9479-95cb-4cd0-b6ef-00e3fdcce7b0 None admin] PATH_INFO: `/v3/users/1f3b10cc801a4e79ba83970a55044fb1` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:17.097944 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec9479-95cb-4cd0-b6ef-00e3fdcce7b0 None admin] RBAC: Authorizing `identity:get_user(user_id=1f3b10cc801a4e79ba83970a55044fb1)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:17.099400 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec9479-95cb-4cd0-b6ef-00e3fdcce7b0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:17.101058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 590/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:16 2022] GET /identity/v3/users/1f3b10cc801a4e79ba83970a55044fb1 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:17.107432 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc889bb8-06a5-4c4c-bfee-b86eecf02e9e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:17.153783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:17.217903 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc889bb8-06a5-4c4c-bfee-b86eecf02e9e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:17.264646 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d4925-7bf3-431c-9540-b9dff4e1dc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:17.265550 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4925-7bf3-431c-9540-b9dff4e1dc77 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:17.265834 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4925-7bf3-431c-9540-b9dff4e1dc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:17.266111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4925-7bf3-431c-9540-b9dff4e1dc77 None admin] PATH_INFO: `/v3/projects/433463b87740417484f1d2ebfe640777` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:17.267361 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d4925-7bf3-431c-9540-b9dff4e1dc77 None admin] RBAC: Authorizing `identity:get_project(project_id=433463b87740417484f1d2ebfe640777)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:17.268805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d4925-7bf3-431c-9540-b9dff4e1dc77 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:17.270568 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 562/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:17 2022] GET /identity/v3/projects/433463b87740417484f1d2ebfe640777 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:17.276894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec9479-95cb-4cd0-b6ef-00e3fdcce7b0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:17.348719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:17.389044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec9479-95cb-4cd0-b6ef-00e3fdcce7b0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:17.423469 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daedda4-d08c-4264-a98f-28deeab1cb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:17.424351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daedda4-d08c-4264-a98f-28deeab1cb5b None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:17.424630 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daedda4-d08c-4264-a98f-28deeab1cb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:17.424898 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daedda4-d08c-4264-a98f-28deeab1cb5b None admin] PATH_INFO: `/v3/projects/433463b87740417484f1d2ebfe640777/users/1f3b10cc801a4e79ba83970a55044fb1/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:17.427113 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daedda4-d08c-4264-a98f-28deeab1cb5b None admin] RBAC: Authorizing `identity:create_grant(project_id=433463b87740417484f1d2ebfe640777, user_id=1f3b10cc801a4e79ba83970a55044fb1, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:17.428546 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daedda4-d08c-4264-a98f-28deeab1cb5b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:17.443918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 591/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:54:17 2022] PUT /identity/v3/projects/433463b87740417484f1d2ebfe640777/users/1f3b10cc801a4e79ba83970a55044fb1/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:54:19.446617 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158114c-0b5c-40a2-a759-7acd91a2fbf7 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:19.447211 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158114c-0b5c-40a2-a759-7acd91a2fbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:19.447211 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158114c-0b5c-40a2-a759-7acd91a2fbf7 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:19.448626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 563/1154] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:19.455373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5442-07b3-48b0-b923-ce8ec19cc10a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:19.456060 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5442-07b3-48b0-b923-ce8ec19cc10a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:19.456319 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5442-07b3-48b0-b923-ce8ec19cc10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:19.482627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3ccc5442-07b3-48b0-b923-ce8ec19cc10a None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:19.483822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3ccc5442-07b3-48b0-b923-ce8ec19cc10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:19.552805 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 592/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:19.576144 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158114c-0b5c-40a2-a759-7acd91a2fbf7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:19.685507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158114c-0b5c-40a2-a759-7acd91a2fbf7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:19.695614 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:19.721892 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d257d44-da8b-4064-b11c-bbc258bc4ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:19.722611 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d257d44-da8b-4064-b11c-bbc258bc4ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:19.722891 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d257d44-da8b-4064-b11c-bbc258bc4ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:19.723163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d257d44-da8b-4064-b11c-bbc258bc4ef5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:19.733813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d257d44-da8b-4064-b11c-bbc258bc4ef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9d257d44-da8b-4064-b11c-bbc258bc4ef5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:19.741374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:19.742460 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:54:19.743490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 564/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:19.749322 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc5442-07b3-48b0-b923-ce8ec19cc10a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:19.818280 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:19.865408 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc5442-07b3-48b0-b923-ce8ec19cc10a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:19.900283 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca3cfd-d215-4e60-b698-d8035ae49394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:19.900942 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca3cfd-d215-4e60-b698-d8035ae49394 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:19.901250 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca3cfd-d215-4e60-b698-d8035ae49394 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:19.901566 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca3cfd-d215-4e60-b698-d8035ae49394 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:19.902316 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca3cfd-d215-4e60-b698-d8035ae49394 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:19.902612 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca3cfd-d215-4e60-b698-d8035ae49394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:19.903985 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca3cfd-d215-4e60-b698-d8035ae49394 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:19.912376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 593/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:19.921003 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d257d44-da8b-4064-b11c-bbc258bc4ef5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:20.035236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d257d44-da8b-4064-b11c-bbc258bc4ef5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:20.074128 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995f6ad-5233-4703-abc7-dee95ff0d284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:20.075011 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995f6ad-5233-4703-abc7-dee95ff0d284 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:20.075292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995f6ad-5233-4703-abc7-dee95ff0d284 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:20.075565 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995f6ad-5233-4703-abc7-dee95ff0d284 None admin] PATH_INFO: `/v3/users/1f3b10cc801a4e79ba83970a55044fb1` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:20.076814 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995f6ad-5233-4703-abc7-dee95ff0d284 None admin] RBAC: Authorizing `identity:get_user(user_id=1f3b10cc801a4e79ba83970a55044fb1)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:20.078294 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995f6ad-5233-4703-abc7-dee95ff0d284 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:20.079933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 565/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:19 2022] GET /identity/v3/users/1f3b10cc801a4e79ba83970a55044fb1 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:54:20.088846 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca3cfd-d215-4e60-b698-d8035ae49394 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:20.192732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca3cfd-d215-4e60-b698-d8035ae49394 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:20.210078 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:20.229508 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477a94a-5019-472c-b520-dd3a4db6206e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:20.230201 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477a94a-5019-472c-b520-dd3a4db6206e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:20.230491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477a94a-5019-472c-b520-dd3a4db6206e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:20.230765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477a94a-5019-472c-b520-dd3a4db6206e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:20.299967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477a94a-5019-472c-b520-dd3a4db6206e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:20.301387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477a94a-5019-472c-b520-dd3a4db6206e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:20.402652 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 594/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:54:20.409088 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995f6ad-5233-4703-abc7-dee95ff0d284 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:20.450731 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:20.517608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995f6ad-5233-4703-abc7-dee95ff0d284 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:20.552480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71d770-80da-40d5-9d2b-42ca60aa3891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:20.553271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d770-80da-40d5-9d2b-42ca60aa3891 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:20.553579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d770-80da-40d5-9d2b-42ca60aa3891 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:20.553841 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d770-80da-40d5-9d2b-42ca60aa3891 None admin] PATH_INFO: `/v3/projects/433463b87740417484f1d2ebfe640777` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:20.555148 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71d770-80da-40d5-9d2b-42ca60aa3891 None admin] RBAC: Authorizing `identity:get_project(project_id=433463b87740417484f1d2ebfe640777)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:20.556589 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71d770-80da-40d5-9d2b-42ca60aa3891 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:20.558393 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 566/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:20 2022] GET /identity/v3/projects/433463b87740417484f1d2ebfe640777 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:20.564557 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477a94a-5019-472c-b520-dd3a4db6206e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:20.584095 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:20.674424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477a94a-5019-472c-b520-dd3a4db6206e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:20.711354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc85ef-8b50-457a-af7d-358d7c503c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:20.711999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc85ef-8b50-457a-af7d-358d7c503c69 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:20.712279 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc85ef-8b50-457a-af7d-358d7c503c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:20.712550 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc85ef-8b50-457a-af7d-358d7c503c69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:20.713407 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc85ef-8b50-457a-af7d-358d7c503c69 None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=433463b87740417484f1d2ebfe640777, user.id=1f3b10cc801a4e79ba83970a55044fb1) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:20.713721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc85ef-8b50-457a-af7d-358d7c503c69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:20.715214 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc85ef-8b50-457a-af7d-358d7c503c69 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:20.721148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 595/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:20 2022] GET /identity/v3/role_assignments?user.id=1f3b10cc801a4e79ba83970a55044fb1&scope.project.id=433463b87740417484f1d2ebfe640777&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:22.730221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a654-5057-4b29-8210-2bcf30c4cde1 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:22.730761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a654-5057-4b29-8210-2bcf30c4cde1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:22.730761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a654-5057-4b29-8210-2bcf30c4cde1 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:22.732150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 567/1162] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:22.738640 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8623d91-bbd3-4b97-aa12-aae5f65b50a9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:22.739323 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8623d91-bbd3-4b97-aa12-aae5f65b50a9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:22.739488 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8623d91-bbd3-4b97-aa12-aae5f65b50a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:22.759907 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e8623d91-bbd3-4b97-aa12-aae5f65b50a9 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:22.761102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e8623d91-bbd3-4b97-aa12-aae5f65b50a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:22.834681 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 596/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:22.862118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60a654-5057-4b29-8210-2bcf30c4cde1 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:22.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60a654-5057-4b29-8210-2bcf30c4cde1 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:22.973930 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:23.006688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759df21-e7a7-4005-9eb4-95da7b4b140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:23.007333 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759df21-e7a7-4005-9eb4-95da7b4b140a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:23.007611 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759df21-e7a7-4005-9eb4-95da7b4b140a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:23.007885 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759df21-e7a7-4005-9eb4-95da7b4b140a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:23.075480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759df21-e7a7-4005-9eb4-95da7b4b140a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:23.076932 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759df21-e7a7-4005-9eb4-95da7b4b140a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:23.179332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 568/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:54:23.186376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8623d91-bbd3-4b97-aa12-aae5f65b50a9 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:23.205384 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:23.293434 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8623d91-bbd3-4b97-aa12-aae5f65b50a9 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:23.326452 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e026ae-1c7e-481d-aced-0d8bf851a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:23.327251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e026ae-1c7e-481d-aced-0d8bf851a78a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:23.327537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e026ae-1c7e-481d-aced-0d8bf851a78a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:23.327810 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e026ae-1c7e-481d-aced-0d8bf851a78a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:23.334934 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e026ae-1c7e-481d-aced-0d8bf851a78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:23.336380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e026ae-1c7e-481d-aced-0d8bf851a78a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-82e026ae-1c7e-481d-aced-0d8bf851a78a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:23.350342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:23.351513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 24 00:54:23.352527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:54:23.356494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 597/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Jul 24 00:54:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:23.357629 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759df21-e7a7-4005-9eb4-95da7b4b140a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:23.360749 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:23.458297 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759df21-e7a7-4005-9eb4-95da7b4b140a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:23.493580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be99142-b105-4279-a27a-3a40137dd11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:23.494228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be99142-b105-4279-a27a-3a40137dd11a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:23.494514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be99142-b105-4279-a27a-3a40137dd11a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:23.494787 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be99142-b105-4279-a27a-3a40137dd11a None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:23.495567 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be99142-b105-4279-a27a-3a40137dd11a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:23.495871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be99142-b105-4279-a27a-3a40137dd11a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:23.497252 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be99142-b105-4279-a27a-3a40137dd11a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:23.504447 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 569/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Jul 24 00:54:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:25.499450 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a39a7-3940-4f7d-bf7a-5733559197b3 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:25.500019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a39a7-3940-4f7d-bf7a-5733559197b3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:25.500019 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a39a7-3940-4f7d-bf7a-5733559197b3 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:25.501435 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 598/1167] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:25.507759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3f1a-edb2-42e1-ab8f-e9049ba3a7d5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:25.508473 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3f1a-edb2-42e1-ab8f-e9049ba3a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:25.508633 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3f1a-edb2-42e1-ab8f-e9049ba3a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:25.527689 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f1fc3f1a-edb2-42e1-ab8f-e9049ba3a7d5 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:25.528999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f1fc3f1a-edb2-42e1-ab8f-e9049ba3a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:25.598995 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:25.606082 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 570/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:25.629597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a39a7-3940-4f7d-bf7a-5733559197b3 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:25.708561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:25.754400 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a39a7-3940-4f7d-bf7a-5733559197b3 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:25.788682 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad153a-3bff-4d22-b974-cbc7207f2984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:25.789370 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad153a-3bff-4d22-b974-cbc7207f2984 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:25.789651 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad153a-3bff-4d22-b974-cbc7207f2984 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:25.789923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad153a-3bff-4d22-b974-cbc7207f2984 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:25.790663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad153a-3bff-4d22-b974-cbc7207f2984 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:25.792067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad153a-3bff-4d22-b974-cbc7207f2984 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:25.809631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 599/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Sun Jul 24 00:54:25 2022] POST /identity/v3/domains => generated 267 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:54:27.833267 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d57c8-0f31-4d36-915e-fc4b96bf04bb None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:27.834177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d57c8-0f31-4d36-915e-fc4b96bf04bb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:27.834177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d57c8-0f31-4d36-915e-fc4b96bf04bb None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:27.836389 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 571/1170] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:27.842775 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d53ccd-12f2-4b90-a016-067a58bcb9f2 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:27.843583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d53ccd-12f2-4b90-a016-067a58bcb9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:27.843754 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d53ccd-12f2-4b90-a016-067a58bcb9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:27.865575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-45d53ccd-12f2-4b90-a016-067a58bcb9f2 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:27.866756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-45d53ccd-12f2-4b90-a016-067a58bcb9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:27.936514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 600/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:27.967431 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d57c8-0f31-4d36-915e-fc4b96bf04bb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:28.076736 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d57c8-0f31-4d36-915e-fc4b96bf04bb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:28.115651 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b951e-f2d5-4648-b4d1-2d37a1b8ea44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:28.116834 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b951e-f2d5-4648-b4d1-2d37a1b8ea44 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:28.117255 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b951e-f2d5-4648-b4d1-2d37a1b8ea44 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:28.117669 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b951e-f2d5-4648-b4d1-2d37a1b8ea44 None admin] PATH_INFO: `/v3/domains/4133ca69221f4727ae6f004b693c7b9d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:28.129907 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b951e-f2d5-4648-b4d1-2d37a1b8ea44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4133ca69221f4727ae6f004b693c7b9d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:28.131375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b951e-f2d5-4648-b4d1-2d37a1b8ea44 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:28.133043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 572/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Sun Jul 24 00:54:27 2022] GET /identity/v3/domains/4133ca69221f4727ae6f004b693c7b9d => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:28.139130 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d53ccd-12f2-4b90-a016-067a58bcb9f2 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:28.203352 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:28.244128 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d53ccd-12f2-4b90-a016-067a58bcb9f2 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:28.279332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975456c2-c96d-43fa-ba67-2f84ddf0315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:28.279995 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975456c2-c96d-43fa-ba67-2f84ddf0315c None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:28.280276 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975456c2-c96d-43fa-ba67-2f84ddf0315c None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:28.280547 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975456c2-c96d-43fa-ba67-2f84ddf0315c None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:28.281251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975456c2-c96d-43fa-ba67-2f84ddf0315c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:28.282718 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975456c2-c96d-43fa-ba67-2f84ddf0315c None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:28.311507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 601/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:54:28 2022] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:54:30.347855 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009a961-55b1-42f2-a9fd-3983c861910a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:30.348713 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009a961-55b1-42f2-a9fd-3983c861910a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:30.348713 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009a961-55b1-42f2-a9fd-3983c861910a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:30.350996 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 573/1174] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:30.357499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1573d-d170-4753-a3e5-8c1d4c7f91a9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:30.357937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1573d-d170-4753-a3e5-8c1d4c7f91a9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:30.358091 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1573d-d170-4753-a3e5-8c1d4c7f91a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:30.380175 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-e3f1573d-d170-4753-a3e5-8c1d4c7f91a9 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:30.381409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e3f1573d-d170-4753-a3e5-8c1d4c7f91a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:30.455240 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 602/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:30.483307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009a961-55b1-42f2-a9fd-3983c861910a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:30.548480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:30.593182 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009a961-55b1-42f2-a9fd-3983c861910a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:30.629725 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ad149-c7d5-4ed9-963d-ccabefa44607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:30.630532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ad149-c7d5-4ed9-963d-ccabefa44607 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:30.630812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ad149-c7d5-4ed9-963d-ccabefa44607 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:30.631090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ad149-c7d5-4ed9-963d-ccabefa44607 None admin] PATH_INFO: `/v3/domains/4133ca69221f4727ae6f004b693c7b9d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:30.632399 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ad149-c7d5-4ed9-963d-ccabefa44607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4133ca69221f4727ae6f004b693c7b9d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:30.633882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ad149-c7d5-4ed9-963d-ccabefa44607 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:30.635583 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 574/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Sun Jul 24 00:54:30 2022] GET /identity/v3/domains/4133ca69221f4727ae6f004b693c7b9d => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:30.642229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1573d-d170-4753-a3e5-8c1d4c7f91a9 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:30.696988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:30.766151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1573d-d170-4753-a3e5-8c1d4c7f91a9 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:30.804510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d00ae-c1ad-4680-b5a0-31648856b544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:30.805188 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d00ae-c1ad-4680-b5a0-31648856b544 None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:30.805506 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d00ae-c1ad-4680-b5a0-31648856b544 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:30.805784 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d00ae-c1ad-4680-b5a0-31648856b544 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:30.806490 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d00ae-c1ad-4680-b5a0-31648856b544 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:30.807973 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d00ae-c1ad-4680-b5a0-31648856b544 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:30.836974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 603/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:54:30 2022] POST /identity/v3/users => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:54:32.887896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389952b4-623c-4fd4-ae1a-bed8e6d3021c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:32.888445 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389952b4-623c-4fd4-ae1a-bed8e6d3021c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:32.888445 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389952b4-623c-4fd4-ae1a-bed8e6d3021c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:32.889789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 575/1178] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:32.902015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d415e-ede8-48b2-8f71-fad1982517f7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:32.902716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d415e-ede8-48b2-8f71-fad1982517f7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:32.902906 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d415e-ede8-48b2-8f71-fad1982517f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:32.924539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-998d415e-ede8-48b2-8f71-fad1982517f7 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:32.925749 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-998d415e-ede8-48b2-8f71-fad1982517f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:32.994368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 604/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:33.018046 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389952b4-623c-4fd4-ae1a-bed8e6d3021c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:33.127388 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389952b4-623c-4fd4-ae1a-bed8e6d3021c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:33.153707 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:33.168286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96668c7b-88fe-4a4f-abcd-1a6c02be8441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:33.169079 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96668c7b-88fe-4a4f-abcd-1a6c02be8441 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:33.169393 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96668c7b-88fe-4a4f-abcd-1a6c02be8441 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:33.169665 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96668c7b-88fe-4a4f-abcd-1a6c02be8441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:33.180336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96668c7b-88fe-4a4f-abcd-1a6c02be8441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-96668c7b-88fe-4a4f-abcd-1a6c02be8441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:33.187874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:33.188989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:54:33.190087 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 576/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:33.195283 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d415e-ede8-48b2-8f71-fad1982517f7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:33.227566 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:33.303897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d415e-ede8-48b2-8f71-fad1982517f7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:33.340974 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f6f37-d63f-418f-a0c0-a6f18eda29f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:33.342017 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f6f37-d63f-418f-a0c0-a6f18eda29f5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:33.342447 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f6f37-d63f-418f-a0c0-a6f18eda29f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:33.342940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f6f37-d63f-418f-a0c0-a6f18eda29f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:33.344279 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f6f37-d63f-418f-a0c0-a6f18eda29f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:33.344815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f6f37-d63f-418f-a0c0-a6f18eda29f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:33.346338 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f6f37-d63f-418f-a0c0-a6f18eda29f5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:33.354455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 605/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:33.363392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96668c7b-88fe-4a4f-abcd-1a6c02be8441 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:33.473161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96668c7b-88fe-4a4f-abcd-1a6c02be8441 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:33.511879 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fd54d-e63b-4322-bf6d-ef417104ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:33.512741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fd54d-e63b-4322-bf6d-ef417104ccdd None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:33.513029 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fd54d-e63b-4322-bf6d-ef417104ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:33.513336 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fd54d-e63b-4322-bf6d-ef417104ccdd None admin] PATH_INFO: `/v3/users/2494f7e1c57649c1b0aa9c4475e55bd3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:33.533244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fd54d-e63b-4322-bf6d-ef417104ccdd None admin] RBAC: Authorizing `identity:get_user(user_id=2494f7e1c57649c1b0aa9c4475e55bd3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:33.534743 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fd54d-e63b-4322-bf6d-ef417104ccdd None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:33.536422 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 577/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:33 2022] GET /identity/v3/users/2494f7e1c57649c1b0aa9c4475e55bd3 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:33.542669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f6f37-d63f-418f-a0c0-a6f18eda29f5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:33.638381 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:33.648272 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f6f37-d63f-418f-a0c0-a6f18eda29f5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:33.683221 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b02c05-ca5f-4c76-99d8-5807eb245816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:33.683868 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b02c05-ca5f-4c76-99d8-5807eb245816 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:33.684150 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b02c05-ca5f-4c76-99d8-5807eb245816 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:33.684424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b02c05-ca5f-4c76-99d8-5807eb245816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:33.756212 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b02c05-ca5f-4c76-99d8-5807eb245816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:33.757634 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b02c05-ca5f-4c76-99d8-5807eb245816 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:33.860540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:33.872164 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 606/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:54:33.881728 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fd54d-e63b-4322-bf6d-ef417104ccdd None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:33.930771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:33.986863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fd54d-e63b-4322-bf6d-ef417104ccdd None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:34.022322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a696e-7d85-469c-a052-819d2383dcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:34.023111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a696e-7d85-469c-a052-819d2383dcb8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:34.023394 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a696e-7d85-469c-a052-819d2383dcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:34.023667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a696e-7d85-469c-a052-819d2383dcb8 None admin] PATH_INFO: `/v3/projects/a845172f894c408483cb1e752f7a5b13` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:34.024968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a696e-7d85-469c-a052-819d2383dcb8 None admin] RBAC: Authorizing `identity:get_project(project_id=a845172f894c408483cb1e752f7a5b13)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:34.026500 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a696e-7d85-469c-a052-819d2383dcb8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:34.028210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 578/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:33 2022] GET /identity/v3/projects/a845172f894c408483cb1e752f7a5b13 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:34.035251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b02c05-ca5f-4c76-99d8-5807eb245816 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:34.145960 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b02c05-ca5f-4c76-99d8-5807eb245816 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:34.186593 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe07d-129c-4b46-ab40-81bb85f7a229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:34.187249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe07d-129c-4b46-ab40-81bb85f7a229 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:34.187531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe07d-129c-4b46-ab40-81bb85f7a229 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:34.187800 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe07d-129c-4b46-ab40-81bb85f7a229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:34.188654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfe07d-129c-4b46-ab40-81bb85f7a229 None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=a845172f894c408483cb1e752f7a5b13, user.id=2494f7e1c57649c1b0aa9c4475e55bd3) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:34.188960 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfe07d-129c-4b46-ab40-81bb85f7a229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:34.190433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfe07d-129c-4b46-ab40-81bb85f7a229 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:34.196239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 607/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:34 2022] GET /identity/v3/role_assignments?user.id=2494f7e1c57649c1b0aa9c4475e55bd3&scope.project.id=a845172f894c408483cb1e752f7a5b13&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:36.203178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46f65-ceed-43f0-9c98-3c86ea82d4de None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:36.204094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46f65-ceed-43f0-9c98-3c86ea82d4de None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:36.204094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46f65-ceed-43f0-9c98-3c86ea82d4de None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:36.206653 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 579/1186] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:36.215282 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ec9ee-5fb6-48dc-a672-8ad500a2623c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:36.215711 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ec9ee-5fb6-48dc-a672-8ad500a2623c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:36.215869 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ec9ee-5fb6-48dc-a672-8ad500a2623c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:36.238766 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0d4ec9ee-5fb6-48dc-a672-8ad500a2623c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:36.239953 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0d4ec9ee-5fb6-48dc-a672-8ad500a2623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:36.298970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:36.316390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 608/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:36.339500 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae46f65-ceed-43f0-9c98-3c86ea82d4de None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:36.449556 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae46f65-ceed-43f0-9c98-3c86ea82d4de None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:36.463766 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:36.486827 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69890c80-b156-4c09-aea0-9e6fabd4d247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:36.487605 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69890c80-b156-4c09-aea0-9e6fabd4d247 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:36.487874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69890c80-b156-4c09-aea0-9e6fabd4d247 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:36.488141 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69890c80-b156-4c09-aea0-9e6fabd4d247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:36.498829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69890c80-b156-4c09-aea0-9e6fabd4d247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-69890c80-b156-4c09-aea0-9e6fabd4d247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:36.506344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:36.507479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:54:36.508444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 580/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:36.513765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ec9ee-5fb6-48dc-a672-8ad500a2623c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:36.615111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ec9ee-5fb6-48dc-a672-8ad500a2623c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:36.650939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290cd47-36a3-466f-b833-5394c3d94d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:36.651593 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290cd47-36a3-466f-b833-5394c3d94d21 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:36.651872 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290cd47-36a3-466f-b833-5394c3d94d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:36.652146 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290cd47-36a3-466f-b833-5394c3d94d21 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:36.652891 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290cd47-36a3-466f-b833-5394c3d94d21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:36.653195 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290cd47-36a3-466f-b833-5394c3d94d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:36.654599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290cd47-36a3-466f-b833-5394c3d94d21 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:36.662803 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 609/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:54:36.671859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69890c80-b156-4c09-aea0-9e6fabd4d247 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:36.777291 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69890c80-b156-4c09-aea0-9e6fabd4d247 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:36.816612 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f61d14-b20d-420e-b38d-4991cca41eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:36.817504 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f61d14-b20d-420e-b38d-4991cca41eea None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:36.817771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f61d14-b20d-420e-b38d-4991cca41eea None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:36.818049 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f61d14-b20d-420e-b38d-4991cca41eea None admin] PATH_INFO: `/v3/users/2494f7e1c57649c1b0aa9c4475e55bd3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:36.819270 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f61d14-b20d-420e-b38d-4991cca41eea None admin] RBAC: Authorizing `identity:get_user(user_id=2494f7e1c57649c1b0aa9c4475e55bd3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:36.820707 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f61d14-b20d-420e-b38d-4991cca41eea None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:36.822355 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 581/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:36 2022] GET /identity/v3/users/2494f7e1c57649c1b0aa9c4475e55bd3 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:36.828654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290cd47-36a3-466f-b833-5394c3d94d21 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:36.891222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:36.945673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290cd47-36a3-466f-b833-5394c3d94d21 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:36.980880 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c133bd1-10b4-4ba1-bcd7-0593b0a8b55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:36.981766 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c133bd1-10b4-4ba1-bcd7-0593b0a8b55a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:36.982044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c133bd1-10b4-4ba1-bcd7-0593b0a8b55a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:36.982319 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c133bd1-10b4-4ba1-bcd7-0593b0a8b55a None admin] PATH_INFO: `/v3/projects/a845172f894c408483cb1e752f7a5b13` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:36.983541 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c133bd1-10b4-4ba1-bcd7-0593b0a8b55a None admin] RBAC: Authorizing `identity:get_project(project_id=a845172f894c408483cb1e752f7a5b13)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:36.984978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c133bd1-10b4-4ba1-bcd7-0593b0a8b55a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:36.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 610/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:36 2022] GET /identity/v3/projects/a845172f894c408483cb1e752f7a5b13 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:54:36.995582 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f61d14-b20d-420e-b38d-4991cca41eea None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:37.039252 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:37.103002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f61d14-b20d-420e-b38d-4991cca41eea None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:37.137762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2e4b9-2f0d-406a-9325-c739047e4159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:37.138646 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2e4b9-2f0d-406a-9325-c739047e4159 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:37.138921 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2e4b9-2f0d-406a-9325-c739047e4159 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:37.139190 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2e4b9-2f0d-406a-9325-c739047e4159 None admin] PATH_INFO: `/v3/projects/a845172f894c408483cb1e752f7a5b13/users/2494f7e1c57649c1b0aa9c4475e55bd3/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:37.141415 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2e4b9-2f0d-406a-9325-c739047e4159 None admin] RBAC: Authorizing `identity:create_grant(project_id=a845172f894c408483cb1e752f7a5b13, user_id=2494f7e1c57649c1b0aa9c4475e55bd3, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:37.142851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2e4b9-2f0d-406a-9325-c739047e4159 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:37.158816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 582/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:54:36 2022] PUT /identity/v3/projects/a845172f894c408483cb1e752f7a5b13/users/2494f7e1c57649c1b0aa9c4475e55bd3/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:54:39.140253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b25c8-8128-48ec-917f-59e521d0e182 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:39.141152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b25c8-8128-48ec-917f-59e521d0e182 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:39.141152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b25c8-8128-48ec-917f-59e521d0e182 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:39.143406 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 611/1193] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:54:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:39.149425 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028d5b8-cdaf-4132-90b5-4b19f6db798f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:39.149862 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028d5b8-cdaf-4132-90b5-4b19f6db798f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:39.149962 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028d5b8-cdaf-4132-90b5-4b19f6db798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:39.174224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8028d5b8-cdaf-4132-90b5-4b19f6db798f None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:39.175434 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8028d5b8-cdaf-4132-90b5-4b19f6db798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:39.247688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 583/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:39.282048 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b25c8-8128-48ec-917f-59e521d0e182 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:39.387490 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b25c8-8128-48ec-917f-59e521d0e182 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:39.404030 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:39.424967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154639e-67a1-410a-bc78-d578af757d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:39.425752 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154639e-67a1-410a-bc78-d578af757d56 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:39.426031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154639e-67a1-410a-bc78-d578af757d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:39.426305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154639e-67a1-410a-bc78-d578af757d56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:39.438461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154639e-67a1-410a-bc78-d578af757d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-b154639e-67a1-410a-bc78-d578af757d56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:39.446000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:39.447056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:54:39.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 612/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:39.453977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028d5b8-cdaf-4132-90b5-4b19f6db798f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:39.500795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:39.576118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028d5b8-cdaf-4132-90b5-4b19f6db798f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:39.619927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5d3f0-ebfa-466e-8fa6-6368ecfbaeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:39.621011 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5d3f0-ebfa-466e-8fa6-6368ecfbaeb1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:39.621387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5d3f0-ebfa-466e-8fa6-6368ecfbaeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:39.621667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5d3f0-ebfa-466e-8fa6-6368ecfbaeb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:39.622698 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5d3f0-ebfa-466e-8fa6-6368ecfbaeb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:39.623236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5d3f0-ebfa-466e-8fa6-6368ecfbaeb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:39.624781 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5d3f0-ebfa-466e-8fa6-6368ecfbaeb1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:39.634169 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 584/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:39.644152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154639e-67a1-410a-bc78-d578af757d56 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:39.758471 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154639e-67a1-410a-bc78-d578af757d56 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:39.798202 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8f7a-b0db-4378-b65a-19d5e3e2ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:39.799079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8f7a-b0db-4378-b65a-19d5e3e2ef6b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:39.799368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8f7a-b0db-4378-b65a-19d5e3e2ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:39.799643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8f7a-b0db-4378-b65a-19d5e3e2ef6b None admin] PATH_INFO: `/v3/users/2494f7e1c57649c1b0aa9c4475e55bd3` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:39.800990 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b8f7a-b0db-4378-b65a-19d5e3e2ef6b None admin] RBAC: Authorizing `identity:get_user(user_id=2494f7e1c57649c1b0aa9c4475e55bd3)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:39.802505 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b8f7a-b0db-4378-b65a-19d5e3e2ef6b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:39.804210 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 613/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:39 2022] GET /identity/v3/users/2494f7e1c57649c1b0aa9c4475e55bd3 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:39.810462 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5d3f0-ebfa-466e-8fa6-6368ecfbaeb1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:39.904487 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:39.918998 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5d3f0-ebfa-466e-8fa6-6368ecfbaeb1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:39.961437 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bce0ad-3a46-44ef-875e-b16b54c0a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:39.962103 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce0ad-3a46-44ef-875e-b16b54c0a0cb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:39.962384 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce0ad-3a46-44ef-875e-b16b54c0a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:39.962659 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce0ad-3a46-44ef-875e-b16b54c0a0cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:40.037668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bce0ad-3a46-44ef-875e-b16b54c0a0cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:40.039058 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bce0ad-3a46-44ef-875e-b16b54c0a0cb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:40.141014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:40.154084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 585/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:54:40.163209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8f7a-b0db-4378-b65a-19d5e3e2ef6b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:40.224507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:40.286761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8f7a-b0db-4378-b65a-19d5e3e2ef6b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:40.323757 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09208f6-e10d-43d4-9532-cde389dab626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:40.324546 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09208f6-e10d-43d4-9532-cde389dab626 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:40.324820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09208f6-e10d-43d4-9532-cde389dab626 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:40.325090 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09208f6-e10d-43d4-9532-cde389dab626 None admin] PATH_INFO: `/v3/projects/a845172f894c408483cb1e752f7a5b13` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:40.326330 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09208f6-e10d-43d4-9532-cde389dab626 None admin] RBAC: Authorizing `identity:get_project(project_id=a845172f894c408483cb1e752f7a5b13)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:40.327764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09208f6-e10d-43d4-9532-cde389dab626 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:40.329841 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 614/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:40 2022] GET /identity/v3/projects/a845172f894c408483cb1e752f7a5b13 => generated 361 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:40.336854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bce0ad-3a46-44ef-875e-b16b54c0a0cb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:40.443305 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bce0ad-3a46-44ef-875e-b16b54c0a0cb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:40.479495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7286d-06e4-4365-af1e-eebf8c7704f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:40.480141 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7286d-06e4-4365-af1e-eebf8c7704f8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:40.480420 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7286d-06e4-4365-af1e-eebf8c7704f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:40.480692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7286d-06e4-4365-af1e-eebf8c7704f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:40.481569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7286d-06e4-4365-af1e-eebf8c7704f8 None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=a845172f894c408483cb1e752f7a5b13, user.id=2494f7e1c57649c1b0aa9c4475e55bd3) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:40.481874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7286d-06e4-4365-af1e-eebf8c7704f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:40.483317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7286d-06e4-4365-af1e-eebf8c7704f8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:40.489320 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 586/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:40 2022] GET /identity/v3/role_assignments?user.id=2494f7e1c57649c1b0aa9c4475e55bd3&scope.project.id=a845172f894c408483cb1e752f7a5b13&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:50.318301 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=44 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:50.486674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=72 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:35.447747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b6986-22b6-4e76-905d-fda20cb2cf14 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:35.448387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b6986-22b6-4e76-905d-fda20cb2cf14 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:35.448387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b6986-22b6-4e76-905d-fda20cb2cf14 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:35.449742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 615/1201] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:55:35.455819 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a904d-d670-476b-bd21-cc8026b4ba14 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:35.456272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a904d-d670-476b-bd21-cc8026b4ba14 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:35.456366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a904d-d670-476b-bd21-cc8026b4ba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:35.477680 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-793a904d-d670-476b-bd21-cc8026b4ba14 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:55:35.479130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-793a904d-d670-476b-bd21-cc8026b4ba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:55:35.559521 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 587/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:55:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:55:35.584152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b6986-22b6-4e76-905d-fda20cb2cf14 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:35.723435 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b6986-22b6-4e76-905d-fda20cb2cf14 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:35.766896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1629b-3735-4973-9ad4-1b4c09bfb63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:35.767887 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1629b-3735-4973-9ad4-1b4c09bfb63b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:35.768265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1629b-3735-4973-9ad4-1b4c09bfb63b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:35.768549 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1629b-3735-4973-9ad4-1b4c09bfb63b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:35.782046 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1629b-3735-4973-9ad4-1b4c09bfb63b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:35.784153 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1629b-3735-4973-9ad4-1b4c09bfb63b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-9bc1629b-3735-4973-9ad4-1b4c09bfb63b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:35.805772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:35.806892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:35.808024 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:35.808024 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:35.808024 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:35.808024 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:35.808024 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 616/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:35.813818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a904d-d670-476b-bd21-cc8026b4ba14 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:35.943727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a904d-d670-476b-bd21-cc8026b4ba14 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:35.975903 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:35.987468 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb73881-9165-4054-a8ae-ebb7dc392284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:35.988519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb73881-9165-4054-a8ae-ebb7dc392284 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:35.989184 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb73881-9165-4054-a8ae-ebb7dc392284 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:35.989515 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb73881-9165-4054-a8ae-ebb7dc392284 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:35.990322 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb73881-9165-4054-a8ae-ebb7dc392284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:35.990562 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb73881-9165-4054-a8ae-ebb7dc392284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:35.992000 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb73881-9165-4054-a8ae-ebb7dc392284 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:36.017832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 588/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:55:36.018049 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1629b-3735-4973-9ad4-1b4c09bfb63b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:36.082470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:36.143895 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1629b-3735-4973-9ad4-1b4c09bfb63b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:36.192452 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3be7c-26ce-4e06-b384-e9baa36ceadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:36.193276 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3be7c-26ce-4e06-b384-e9baa36ceadc None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:36.193607 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3be7c-26ce-4e06-b384-e9baa36ceadc None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:36.193948 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3be7c-26ce-4e06-b384-e9baa36ceadc None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:36.194720 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3be7c-26ce-4e06-b384-e9baa36ceadc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:36.196445 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3be7c-26ce-4e06-b384-e9baa36ceadc None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:36.222291 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 617/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Jul 24 00:55:36 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:55:38.374992 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669392e4-8c38-497b-b55b-c028123ead49 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:38.375571 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669392e4-8c38-497b-b55b-c028123ead49 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:38.375571 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669392e4-8c38-497b-b55b-c028123ead49 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:38.376985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 589/1206] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:55:38.382562 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691445-4abf-41a6-a5b9-4f0648a487f8 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:38.383031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691445-4abf-41a6-a5b9-4f0648a487f8 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:38.383141 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691445-4abf-41a6-a5b9-4f0648a487f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:38.400373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-35691445-4abf-41a6-a5b9-4f0648a487f8 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:55:38.401597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-35691445-4abf-41a6-a5b9-4f0648a487f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:55:38.477249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 618/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:55:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:55:38.495403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669392e4-8c38-497b-b55b-c028123ead49 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:38.614164 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669392e4-8c38-497b-b55b-c028123ead49 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:38.651408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167104c-0289-4d30-a2c1-003a10b2c07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:38.652203 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167104c-0289-4d30-a2c1-003a10b2c07a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:38.652489 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167104c-0289-4d30-a2c1-003a10b2c07a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:38.652830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167104c-0289-4d30-a2c1-003a10b2c07a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:38.664827 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167104c-0289-4d30-a2c1-003a10b2c07a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-5167104c-0289-4d30-a2c1-003a10b2c07a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:55:38.672829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:38.673939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:55:38.674795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 590/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:55:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:38.681051 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691445-4abf-41a6-a5b9-4f0648a487f8 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:38.734403 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:38.805090 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691445-4abf-41a6-a5b9-4f0648a487f8 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:38.845855 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750221b0-d018-456d-88c2-4eba98de09b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:38.846536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750221b0-d018-456d-88c2-4eba98de09b2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:38.846892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750221b0-d018-456d-88c2-4eba98de09b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:38.847096 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750221b0-d018-456d-88c2-4eba98de09b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:38.847845 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750221b0-d018-456d-88c2-4eba98de09b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:38.848186 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750221b0-d018-456d-88c2-4eba98de09b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:38.850635 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750221b0-d018-456d-88c2-4eba98de09b2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:38.858180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 619/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:55:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:38.864366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167104c-0289-4d30-a2c1-003a10b2c07a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:38.921884 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:38.973373 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167104c-0289-4d30-a2c1-003a10b2c07a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:39.015154 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05830b14-cbf7-480c-841a-8cdaa86f8568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:39.015957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830b14-cbf7-480c-841a-8cdaa86f8568 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:39.016295 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830b14-cbf7-480c-841a-8cdaa86f8568 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:39.016508 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830b14-cbf7-480c-841a-8cdaa86f8568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:39.029837 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05830b14-cbf7-480c-841a-8cdaa86f8568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:39.031436 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05830b14-cbf7-480c-841a-8cdaa86f8568 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-05830b14-cbf7-480c-841a-8cdaa86f8568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:39.050470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:39.051742 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:39.052864 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:39.052864 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:39.052864 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:39.052864 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:55:39.053538 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 591/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:39.059457 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750221b0-d018-456d-88c2-4eba98de09b2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:39.165312 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:39.168915 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750221b0-d018-456d-88c2-4eba98de09b2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:39.203775 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dfa5f-3f0d-4a61-86b1-9fe9e3b0d81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:39.204460 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dfa5f-3f0d-4a61-86b1-9fe9e3b0d81f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:39.204801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dfa5f-3f0d-4a61-86b1-9fe9e3b0d81f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:39.205135 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dfa5f-3f0d-4a61-86b1-9fe9e3b0d81f None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:39.205956 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dfa5f-3f0d-4a61-86b1-9fe9e3b0d81f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:39.206341 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dfa5f-3f0d-4a61-86b1-9fe9e3b0d81f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:39.207750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dfa5f-3f0d-4a61-86b1-9fe9e3b0d81f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:39.223083 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 620/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:39.228945 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05830b14-cbf7-480c-841a-8cdaa86f8568 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:39.346749 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05830b14-cbf7-480c-841a-8cdaa86f8568 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:39.348296 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:39.385037 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734be01-d6f6-432e-8d0f-de81250b8cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:39.385942 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734be01-d6f6-432e-8d0f-de81250b8cde None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:39.386279 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734be01-d6f6-432e-8d0f-de81250b8cde None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:39.386637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734be01-d6f6-432e-8d0f-de81250b8cde None admin] PATH_INFO: `/v3/users/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:39.396817 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734be01-d6f6-432e-8d0f-de81250b8cde None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:39.399320 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734be01-d6f6-432e-8d0f-de81250b8cde None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-5734be01-d6f6-432e-8d0f-de81250b8cde None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:55:39.415615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:39.416859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:39.422678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:39.422678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:39.422678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:55:39.422678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:55:39.422678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:55:39.422678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:55:39.422678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:55:39.422678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:55:39.422678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:55:39.422678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:55:39.422678 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 592/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:39.423501 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dfa5f-3f0d-4a61-86b1-9fe9e3b0d81f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:39.540764 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dfa5f-3f0d-4a61-86b1-9fe9e3b0d81f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:39.588927 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49e048-c8e9-4400-aba4-9232e7ffeb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:39.589728 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49e048-c8e9-4400-aba4-9232e7ffeb07 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:39.590120 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49e048-c8e9-4400-aba4-9232e7ffeb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:39.590509 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49e048-c8e9-4400-aba4-9232e7ffeb07 None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:39.591413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49e048-c8e9-4400-aba4-9232e7ffeb07 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:39.591788 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49e048-c8e9-4400-aba4-9232e7ffeb07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:39.594248 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49e048-c8e9-4400-aba4-9232e7ffeb07 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:39.615508 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 621/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Sun Jul 24 00:55:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:55:39.621176 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734be01-d6f6-432e-8d0f-de81250b8cde None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:39.735138 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734be01-d6f6-432e-8d0f-de81250b8cde None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:39.773612 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf48315-acb1-4659-ba66-65b1bb74e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:39.774783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf48315-acb1-4659-ba66-65b1bb74e69a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:39.775132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf48315-acb1-4659-ba66-65b1bb74e69a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:39.775469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf48315-acb1-4659-ba66-65b1bb74e69a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:39.810133 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:39.854591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf48315-acb1-4659-ba66-65b1bb74e69a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:39.856214 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf48315-acb1-4659-ba66-65b1bb74e69a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:39.965395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 593/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:55:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:55:39.971515 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49e048-c8e9-4400-aba4-9232e7ffeb07 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:39.991679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:40.083175 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49e048-c8e9-4400-aba4-9232e7ffeb07 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:40.123668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17684459-5e4e-4c5a-bbed-1bcbe6d900c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:40.124490 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17684459-5e4e-4c5a-bbed-1bcbe6d900c5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:40.124777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17684459-5e4e-4c5a-bbed-1bcbe6d900c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:40.125185 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17684459-5e4e-4c5a-bbed-1bcbe6d900c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:40.136778 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17684459-5e4e-4c5a-bbed-1bcbe6d900c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:40.138392 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17684459-5e4e-4c5a-bbed-1bcbe6d900c5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-17684459-5e4e-4c5a-bbed-1bcbe6d900c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:40.157849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:40.158878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:40.159783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:40.159783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:40.159783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:40.159783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:40.161241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 622/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:40.168624 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf48315-acb1-4659-ba66-65b1bb74e69a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:40.234954 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:40.276718 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf48315-acb1-4659-ba66-65b1bb74e69a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:40.316318 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6f17b-e99f-4694-978c-6356f3a23f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:40.317244 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6f17b-e99f-4694-978c-6356f3a23f4d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:40.318210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6f17b-e99f-4694-978c-6356f3a23f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:40.318210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6f17b-e99f-4694-978c-6356f3a23f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:40.319020 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6f17b-e99f-4694-978c-6356f3a23f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:40.319597 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6f17b-e99f-4694-978c-6356f3a23f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:40.321447 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6f17b-e99f-4694-978c-6356f3a23f4d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:40.340236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 594/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:40.341354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17684459-5e4e-4c5a-bbed-1bcbe6d900c5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:40.420305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:40.454582 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17684459-5e4e-4c5a-bbed-1bcbe6d900c5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:40.493961 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f356b-0e0a-44d4-82d5-c43fb16e922a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:40.494766 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f356b-0e0a-44d4-82d5-c43fb16e922a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:40.495050 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f356b-0e0a-44d4-82d5-c43fb16e922a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:40.495322 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f356b-0e0a-44d4-82d5-c43fb16e922a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:40.502289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f356b-0e0a-44d4-82d5-c43fb16e922a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:40.503853 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f356b-0e0a-44d4-82d5-c43fb16e922a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-ea1f356b-0e0a-44d4-82d5-c43fb16e922a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:55:40.518643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:40.520922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:55:40.520922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:55:40.520922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:55:40.520922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:55:40.520922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:55:40.520922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:55:40.520922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:55:40.520922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:40.525520 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 623/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:55:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:55:40.527008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6f17b-e99f-4694-978c-6356f3a23f4d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:40.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6f17b-e99f-4694-978c-6356f3a23f4d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:40.662932 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:40.677514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90859d23-8a59-4041-bd2f-f578ef164b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:40.678268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90859d23-8a59-4041-bd2f-f578ef164b60 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:40.678609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90859d23-8a59-4041-bd2f-f578ef164b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:40.678975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90859d23-8a59-4041-bd2f-f578ef164b60 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:40.679875 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90859d23-8a59-4041-bd2f-f578ef164b60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:40.680217 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90859d23-8a59-4041-bd2f-f578ef164b60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:40.681883 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90859d23-8a59-4041-bd2f-f578ef164b60 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:40.695803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 595/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:40.701847 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f356b-0e0a-44d4-82d5-c43fb16e922a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:40.818915 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f356b-0e0a-44d4-82d5-c43fb16e922a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:40.849674 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:40.856855 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46799072-919a-4faf-bc9b-b54f3bf9e584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:40.857634 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46799072-919a-4faf-bc9b-b54f3bf9e584 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:40.857950 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46799072-919a-4faf-bc9b-b54f3bf9e584 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:40.858225 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46799072-919a-4faf-bc9b-b54f3bf9e584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:40.859108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46799072-919a-4faf-bc9b-b54f3bf9e584 None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=cce671a84420484580cfd8efe6a6e227) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:40.859489 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46799072-919a-4faf-bc9b-b54f3bf9e584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:40.861065 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46799072-919a-4faf-bc9b-b54f3bf9e584 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:40.869912 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 624/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:55:40 2022] GET /identity/v3/role_assignments?user.id=cce671a84420484580cfd8efe6a6e227&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:43.012833 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b2959-47de-4009-a9ec-81065f907c4a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:43.013446 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b2959-47de-4009-a9ec-81065f907c4a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:43.013446 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b2959-47de-4009-a9ec-81065f907c4a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:43.014768 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 596/1220] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:55:43.021109 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78914ad1-2006-4a37-bace-f596a7c858ad None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:43.021563 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78914ad1-2006-4a37-bace-f596a7c858ad None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:43.021701 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78914ad1-2006-4a37-bace-f596a7c858ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:43.044413 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-78914ad1-2006-4a37-bace-f596a7c858ad None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:55:43.046154 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-78914ad1-2006-4a37-bace-f596a7c858ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:55:43.129347 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 625/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:55:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:55:43.153022 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b2959-47de-4009-a9ec-81065f907c4a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:43.268765 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b2959-47de-4009-a9ec-81065f907c4a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:43.304802 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657b729-38ae-4d9d-8852-3d5049a98c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:43.305692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657b729-38ae-4d9d-8852-3d5049a98c2c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:43.305998 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657b729-38ae-4d9d-8852-3d5049a98c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:43.306289 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657b729-38ae-4d9d-8852-3d5049a98c2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:43.317644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657b729-38ae-4d9d-8852-3d5049a98c2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f657b729-38ae-4d9d-8852-3d5049a98c2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:55:43.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:43.327163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:55:43.328951 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 597/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:55:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:43.333854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78914ad1-2006-4a37-bace-f596a7c858ad None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:43.435086 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78914ad1-2006-4a37-bace-f596a7c858ad None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:43.460960 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:43.473360 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46aa0d-1c1f-498e-b61c-a610184b00e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:43.474034 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46aa0d-1c1f-498e-b61c-a610184b00e5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:43.474358 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46aa0d-1c1f-498e-b61c-a610184b00e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:43.474709 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46aa0d-1c1f-498e-b61c-a610184b00e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:43.475536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46aa0d-1c1f-498e-b61c-a610184b00e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:43.475776 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46aa0d-1c1f-498e-b61c-a610184b00e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:43.477269 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46aa0d-1c1f-498e-b61c-a610184b00e5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:43.485463 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 626/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:55:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:43.492814 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657b729-38ae-4d9d-8852-3d5049a98c2c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:43.544159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:43.606521 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657b729-38ae-4d9d-8852-3d5049a98c2c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:43.643106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5186f-ca68-4f80-9dce-eb616f73114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:43.643916 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5186f-ca68-4f80-9dce-eb616f73114c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:43.644194 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5186f-ca68-4f80-9dce-eb616f73114c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:43.644487 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5186f-ca68-4f80-9dce-eb616f73114c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:43.656559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5186f-ca68-4f80-9dce-eb616f73114c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:43.658340 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5186f-ca68-4f80-9dce-eb616f73114c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-13b5186f-ca68-4f80-9dce-eb616f73114c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:43.678871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:43.679978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:43.681130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:43.681130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:43.681130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:43.681130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:55:43.681130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 598/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:43.687341 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46aa0d-1c1f-498e-b61c-a610184b00e5 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:43.802134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46aa0d-1c1f-498e-b61c-a610184b00e5 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:43.840687 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648ac48-9fdb-44c6-a7d6-38539e52d727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:43.841458 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648ac48-9fdb-44c6-a7d6-38539e52d727 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:43.841781 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648ac48-9fdb-44c6-a7d6-38539e52d727 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:43.842082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648ac48-9fdb-44c6-a7d6-38539e52d727 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:43.843221 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648ac48-9fdb-44c6-a7d6-38539e52d727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:43.843552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648ac48-9fdb-44c6-a7d6-38539e52d727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:43.845467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648ac48-9fdb-44c6-a7d6-38539e52d727 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:43.859368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 627/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:43.866147 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5186f-ca68-4f80-9dce-eb616f73114c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:43.975967 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:43.984487 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5186f-ca68-4f80-9dce-eb616f73114c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:44.020345 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd94522-4514-4526-b408-f6501d59b290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:44.021160 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd94522-4514-4526-b408-f6501d59b290 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:44.021492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd94522-4514-4526-b408-f6501d59b290 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:44.021778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd94522-4514-4526-b408-f6501d59b290 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:44.030135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd94522-4514-4526-b408-f6501d59b290 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:44.031596 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd94522-4514-4526-b408-f6501d59b290 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-0dd94522-4514-4526-b408-f6501d59b290 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:55:44.046118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:44.047221 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:44.048652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:44.048652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:44.048652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:55:44.048652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:55:44.048652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:55:44.048652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:55:44.048652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:55:44.048652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:55:44.048652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:55:44.048652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:55:44.048652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 599/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:44.053429 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648ac48-9fdb-44c6-a7d6-38539e52d727 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:44.106448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:44.163324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648ac48-9fdb-44c6-a7d6-38539e52d727 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:44.200455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885e15a-692d-483b-ada3-0037dc226f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:44.201195 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885e15a-692d-483b-ada3-0037dc226f2e None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:44.201504 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885e15a-692d-483b-ada3-0037dc226f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:44.201774 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885e15a-692d-483b-ada3-0037dc226f2e None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:44.202610 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885e15a-692d-483b-ada3-0037dc226f2e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:44.202912 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885e15a-692d-483b-ada3-0037dc226f2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:44.204716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885e15a-692d-483b-ada3-0037dc226f2e None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:44.222502 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 628/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Sun Jul 24 00:55:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:44.228560 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd94522-4514-4526-b408-f6501d59b290 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:44.346027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd94522-4514-4526-b408-f6501d59b290 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:44.379812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e831e70-e83c-4077-9eca-348bb6a996d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:44.380615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e831e70-e83c-4077-9eca-348bb6a996d6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:44.380913 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e831e70-e83c-4077-9eca-348bb6a996d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:44.381198 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e831e70-e83c-4077-9eca-348bb6a996d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:44.391668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e831e70-e83c-4077-9eca-348bb6a996d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:44.393135 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e831e70-e83c-4077-9eca-348bb6a996d6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-2e831e70-e83c-4077-9eca-348bb6a996d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:44.409830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:44.410784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:44.411699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:44.411699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:44.411699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:44.411699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:55:44.411699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 600/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:44.417065 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885e15a-692d-483b-ada3-0037dc226f2e None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:44.521634 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885e15a-692d-483b-ada3-0037dc226f2e None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:44.523985 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:44.559899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f506efd-4761-49ee-bb5a-8094cf1d95a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:44.560753 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f506efd-4761-49ee-bb5a-8094cf1d95a1 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:44.561148 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f506efd-4761-49ee-bb5a-8094cf1d95a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:44.561552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f506efd-4761-49ee-bb5a-8094cf1d95a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:44.562385 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f506efd-4761-49ee-bb5a-8094cf1d95a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:44.562876 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f506efd-4761-49ee-bb5a-8094cf1d95a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:44.564786 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f506efd-4761-49ee-bb5a-8094cf1d95a1 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:44.580232 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 629/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:55:44.586421 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e831e70-e83c-4077-9eca-348bb6a996d6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:44.597146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:44.694617 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e831e70-e83c-4077-9eca-348bb6a996d6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:44.729841 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d1c46-61ef-40b5-aea4-058d22bed1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:44.730625 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d1c46-61ef-40b5-aea4-058d22bed1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:44.730904 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d1c46-61ef-40b5-aea4-058d22bed1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:44.731177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d1c46-61ef-40b5-aea4-058d22bed1d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:44.737927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d1c46-61ef-40b5-aea4-058d22bed1d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:44.739412 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d1c46-61ef-40b5-aea4-058d22bed1d6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c03d1c46-61ef-40b5-aea4-058d22bed1d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:55:44.753812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:44.755259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:44.756683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:55:44.756683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:55:44.756683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:55:44.756683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:55:44.756683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:55:44.756683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:55:44.756683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:55:44.756683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:55:44.756683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 601/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:55:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:55:44.761694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f506efd-4761-49ee-bb5a-8094cf1d95a1 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:44.874697 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f506efd-4761-49ee-bb5a-8094cf1d95a1 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:44.909772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65bb30-c0ae-4f67-b282-5dded0f266f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:44.910440 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65bb30-c0ae-4f67-b282-5dded0f266f2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:44.910720 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65bb30-c0ae-4f67-b282-5dded0f266f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:44.910987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65bb30-c0ae-4f67-b282-5dded0f266f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:44.911773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65bb30-c0ae-4f67-b282-5dded0f266f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:44.912074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65bb30-c0ae-4f67-b282-5dded0f266f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:44.913624 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65bb30-c0ae-4f67-b282-5dded0f266f2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:44.925606 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 630/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:55:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:44.932271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d1c46-61ef-40b5-aea4-058d22bed1d6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:45.010019 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:45.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d1c46-61ef-40b5-aea4-058d22bed1d6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:45.082021 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcb9f4-7a2f-4b28-bdd9-451dd6fff593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:45.082952 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcb9f4-7a2f-4b28-bdd9-451dd6fff593 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:45.083241 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcb9f4-7a2f-4b28-bdd9-451dd6fff593 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:45.083494 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcb9f4-7a2f-4b28-bdd9-451dd6fff593 None admin] PATH_INFO: `/v3/projects/f5b7f081bd694cce90cca76194df476e/users/cce671a84420484580cfd8efe6a6e227/roles/ce064f563f9340c9863b6ec5bb273c39` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:45.097935 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcb9f4-7a2f-4b28-bdd9-451dd6fff593 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7f081bd694cce90cca76194df476e, user_id=cce671a84420484580cfd8efe6a6e227, role_id=ce064f563f9340c9863b6ec5bb273c39)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:45.099364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcb9f4-7a2f-4b28-bdd9-451dd6fff593 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:45.111490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 602/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:55:44 2022] PUT /identity/v3/projects/f5b7f081bd694cce90cca76194df476e/users/cce671a84420484580cfd8efe6a6e227/roles/ce064f563f9340c9863b6ec5bb273c39 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:55:47.192535 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2eb1e-c96a-41d9-8bb6-9fb4020e84d7 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:47.193094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2eb1e-c96a-41d9-8bb6-9fb4020e84d7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:47.193094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2eb1e-c96a-41d9-8bb6-9fb4020e84d7 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:47.194813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 631/1233] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:55:47.200435 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75b7ef-fbc1-4900-8bd3-066f77c4b7b9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:47.200912 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75b7ef-fbc1-4900-8bd3-066f77c4b7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:47.201010 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75b7ef-fbc1-4900-8bd3-066f77c4b7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:47.219558 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fd75b7ef-fbc1-4900-8bd3-066f77c4b7b9 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:55:47.220854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fd75b7ef-fbc1-4900-8bd3-066f77c4b7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:55:47.297621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 603/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:55:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:55:47.322934 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2eb1e-c96a-41d9-8bb6-9fb4020e84d7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:47.354129 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:47.435518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2eb1e-c96a-41d9-8bb6-9fb4020e84d7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:47.472007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48eca29-2769-44b3-bce3-a6362f0d5e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:47.472733 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48eca29-2769-44b3-bce3-a6362f0d5e44 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:47.473016 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48eca29-2769-44b3-bce3-a6362f0d5e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:47.473499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48eca29-2769-44b3-bce3-a6362f0d5e44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:47.483807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48eca29-2769-44b3-bce3-a6362f0d5e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-f48eca29-2769-44b3-bce3-a6362f0d5e44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:55:47.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:47.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:47.494387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 632/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Jul 24 00:55:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:47.500040 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75b7ef-fbc1-4900-8bd3-066f77c4b7b9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:47.547684 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:47.603667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75b7ef-fbc1-4900-8bd3-066f77c4b7b9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:47.644396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d21b2-0ceb-4a2c-9b73-3b99022c7a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:47.645092 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d21b2-0ceb-4a2c-9b73-3b99022c7a09 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:47.645409 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d21b2-0ceb-4a2c-9b73-3b99022c7a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:47.645723 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d21b2-0ceb-4a2c-9b73-3b99022c7a09 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:47.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d21b2-0ceb-4a2c-9b73-3b99022c7a09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:47.646797 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d21b2-0ceb-4a2c-9b73-3b99022c7a09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:47.648281 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d21b2-0ceb-4a2c-9b73-3b99022c7a09 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:47.657381 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 604/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Jul 24 00:55:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:47.663774 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48eca29-2769-44b3-bce3-a6362f0d5e44 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:47.756311 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:47.774170 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48eca29-2769-44b3-bce3-a6362f0d5e44 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:47.814697 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5bfe6-13a9-48fd-9d2c-accac52e47fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:47.815776 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5bfe6-13a9-48fd-9d2c-accac52e47fa None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:47.816145 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5bfe6-13a9-48fd-9d2c-accac52e47fa None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:47.816425 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5bfe6-13a9-48fd-9d2c-accac52e47fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:47.829059 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5bfe6-13a9-48fd-9d2c-accac52e47fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:47.830786 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5bfe6-13a9-48fd-9d2c-accac52e47fa None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-68c5bfe6-13a9-48fd-9d2c-accac52e47fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:47.848767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:47.849963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:47.850959 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:47.850959 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:47.850959 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:47.850959 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:47.850959 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 633/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:47.856085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d21b2-0ceb-4a2c-9b73-3b99022c7a09 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:47.956194 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d21b2-0ceb-4a2c-9b73-3b99022c7a09 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:47.965057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:47.989925 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9e010-eb8a-4509-9706-4b8d178fa370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:47.990592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e010-eb8a-4509-9706-4b8d178fa370 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:47.990870 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e010-eb8a-4509-9706-4b8d178fa370 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:47.991130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e010-eb8a-4509-9706-4b8d178fa370 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:47.991879 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9e010-eb8a-4509-9706-4b8d178fa370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:47.992195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9e010-eb8a-4509-9706-4b8d178fa370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:47.993617 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9e010-eb8a-4509-9706-4b8d178fa370 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:48.005781 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 605/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:48.011700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5bfe6-13a9-48fd-9d2c-accac52e47fa None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:48.117253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5bfe6-13a9-48fd-9d2c-accac52e47fa None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:48.151044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a3193-3f86-4804-88ce-3ffae45ed5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:48.151852 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a3193-3f86-4804-88ce-3ffae45ed5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:48.152136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a3193-3f86-4804-88ce-3ffae45ed5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:48.152407 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a3193-3f86-4804-88ce-3ffae45ed5a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:48.155189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:48.161983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a3193-3f86-4804-88ce-3ffae45ed5a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:48.163530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a3193-3f86-4804-88ce-3ffae45ed5a9 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-f60a3193-3f86-4804-88ce-3ffae45ed5a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:55:48.178209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:48.179525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:48.180499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:48.180499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:48.180499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:55:48.180499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:55:48.180499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:55:48.180499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:55:48.180499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:55:48.180499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:55:48.180499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:55:48.180499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:48.180499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 634/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:48.185445 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9e010-eb8a-4509-9706-4b8d178fa370 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:48.297982 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9e010-eb8a-4509-9706-4b8d178fa370 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:48.337147 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fb488-d998-4976-b4e4-5064f63c15d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:48.337866 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fb488-d998-4976-b4e4-5064f63c15d5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:48.338146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fb488-d998-4976-b4e4-5064f63c15d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:48.338424 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fb488-d998-4976-b4e4-5064f63c15d5 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:48.339364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fb488-d998-4976-b4e4-5064f63c15d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:48.339670 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fb488-d998-4976-b4e4-5064f63c15d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:48.341107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fb488-d998-4976-b4e4-5064f63c15d5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:48.358649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 606/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Sun Jul 24 00:55:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:48.364683 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a3193-3f86-4804-88ce-3ffae45ed5a9 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:48.464617 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a3193-3f86-4804-88ce-3ffae45ed5a9 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:48.501165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1151134-c9a4-44f4-b4d2-00d521d9590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:48.501934 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1151134-c9a4-44f4-b4d2-00d521d9590d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:48.502268 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1151134-c9a4-44f4-b4d2-00d521d9590d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:48.502563 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1151134-c9a4-44f4-b4d2-00d521d9590d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:48.569078 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:48.579985 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1151134-c9a4-44f4-b4d2-00d521d9590d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:48.581547 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1151134-c9a4-44f4-b4d2-00d521d9590d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:48.695107 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 635/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:55:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:55:48.701470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fb488-d998-4976-b4e4-5064f63c15d5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:48.734632 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:48.816895 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fb488-d998-4976-b4e4-5064f63c15d5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:48.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14948-2851-406d-afb8-b4f623776ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:48.854413 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14948-2851-406d-afb8-b4f623776ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:48.854698 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14948-2851-406d-afb8-b4f623776ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:48.854976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14948-2851-406d-afb8-b4f623776ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:48.867497 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d14948-2851-406d-afb8-b4f623776ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:48.869321 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d14948-2851-406d-afb8-b4f623776ed5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c6d14948-2851-406d-afb8-b4f623776ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:48.891077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:48.892233 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:48.893163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:48.893163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:48.893163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:48.893163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:55:48.893163 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 607/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:55:48.898852 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1151134-c9a4-44f4-b4d2-00d521d9590d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:49.009264 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:49.016016 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1151134-c9a4-44f4-b4d2-00d521d9590d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:49.053364 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a0f6b-0690-4718-a298-d5c76b42b56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:49.054099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a0f6b-0690-4718-a298-d5c76b42b56d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:49.054380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a0f6b-0690-4718-a298-d5c76b42b56d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:49.054654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a0f6b-0690-4718-a298-d5c76b42b56d None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:49.055491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a0f6b-0690-4718-a298-d5c76b42b56d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:49.055892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a0f6b-0690-4718-a298-d5c76b42b56d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:49.057433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a0f6b-0690-4718-a298-d5c76b42b56d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:49.070792 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 636/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:49.076733 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14948-2851-406d-afb8-b4f623776ed5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:49.168172 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:49.195671 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14948-2851-406d-afb8-b4f623776ed5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:49.237267 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149ddaa-5f3e-4fc0-bd45-5cbdff27a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:49.238090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149ddaa-5f3e-4fc0-bd45-5cbdff27a038 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:49.238374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149ddaa-5f3e-4fc0-bd45-5cbdff27a038 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:49.238650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149ddaa-5f3e-4fc0-bd45-5cbdff27a038 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:49.245908 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149ddaa-5f3e-4fc0-bd45-5cbdff27a038 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:49.247490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149ddaa-5f3e-4fc0-bd45-5cbdff27a038 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-0149ddaa-5f3e-4fc0-bd45-5cbdff27a038 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:55:49.262025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:49.263353 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:49.264282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:55:49.264282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:55:49.264282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:55:49.264282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:55:49.264282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:55:49.264282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:55:49.264282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:55:49.264282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:55:49.264282 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 608/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:55:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:49.269615 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a0f6b-0690-4718-a298-d5c76b42b56d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:49.410837 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a0f6b-0690-4718-a298-d5c76b42b56d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:49.445107 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1784f-e246-4e0b-a529-db40f97cc1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:49.445814 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1784f-e246-4e0b-a529-db40f97cc1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:49.446101 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1784f-e246-4e0b-a529-db40f97cc1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:49.446372 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1784f-e246-4e0b-a529-db40f97cc1f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:49.447160 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1784f-e246-4e0b-a529-db40f97cc1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:49.447465 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1784f-e246-4e0b-a529-db40f97cc1f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:49.448917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1784f-e246-4e0b-a529-db40f97cc1f3 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:49.461998 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 637/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:55:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:49.468910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149ddaa-5f3e-4fc0-bd45-5cbdff27a038 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:49.583125 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149ddaa-5f3e-4fc0-bd45-5cbdff27a038 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:49.629345 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005b3ce-503b-4cea-8e14-bf469715a6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:49.630122 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b3ce-503b-4cea-8e14-bf469715a6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:49.630430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b3ce-503b-4cea-8e14-bf469715a6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:49.630775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b3ce-503b-4cea-8e14-bf469715a6e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:49.631717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005b3ce-503b-4cea-8e14-bf469715a6e6 None admin] RBAC: Adding query filter params (role.id=ce064f563f9340c9863b6ec5bb273c39, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=cce671a84420484580cfd8efe6a6e227) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:49.632219 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005b3ce-503b-4cea-8e14-bf469715a6e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:49.633772 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005b3ce-503b-4cea-8e14-bf469715a6e6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:49.641628 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 609/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:55:49 2022] GET /identity/v3/role_assignments?user.id=cce671a84420484580cfd8efe6a6e227&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=ce064f563f9340c9863b6ec5bb273c39 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:51.896888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1e921-e49e-4306-b82c-a811acd91e01 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:51.897617 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1e921-e49e-4306-b82c-a811acd91e01 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:51.897617 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1e921-e49e-4306-b82c-a811acd91e01 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:51.898849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 638/1247] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:55:51.905026 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee1c70-1f63-4a21-b233-f7f225d5097a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:51.905519 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee1c70-1f63-4a21-b233-f7f225d5097a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:51.905618 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee1c70-1f63-4a21-b233-f7f225d5097a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:51.911862 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:51.926262 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fdee1c70-1f63-4a21-b233-f7f225d5097a None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:55:51.927479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fdee1c70-1f63-4a21-b233-f7f225d5097a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:55:52.005706 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 610/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:55:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:55:52.032288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1e921-e49e-4306-b82c-a811acd91e01 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:52.053462 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:52.145789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1e921-e49e-4306-b82c-a811acd91e01 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:52.182104 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d031df3-8074-42a6-baae-58552e9e9b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:52.183016 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d031df3-8074-42a6-baae-58552e9e9b0a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:52.183343 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d031df3-8074-42a6-baae-58552e9e9b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:52.183649 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d031df3-8074-42a6-baae-58552e9e9b0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:52.196776 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d031df3-8074-42a6-baae-58552e9e9b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-4d031df3-8074-42a6-baae-58552e9e9b0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:55:52.204970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:52.205996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:52.207401 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 639/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:55:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:52.212571 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee1c70-1f63-4a21-b233-f7f225d5097a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:52.324455 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee1c70-1f63-4a21-b233-f7f225d5097a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:52.361586 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:52.368115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1589dc8-5983-4acf-936a-a6515bbf0e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:52.368842 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1589dc8-5983-4acf-936a-a6515bbf0e7c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:52.369130 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1589dc8-5983-4acf-936a-a6515bbf0e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:52.369453 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1589dc8-5983-4acf-936a-a6515bbf0e7c None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:52.370296 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1589dc8-5983-4acf-936a-a6515bbf0e7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:52.370662 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1589dc8-5983-4acf-936a-a6515bbf0e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:52.372040 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1589dc8-5983-4acf-936a-a6515bbf0e7c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:52.381247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 611/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:55:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:55:52.387623 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d031df3-8074-42a6-baae-58552e9e9b0a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:52.475722 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:52.500470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d031df3-8074-42a6-baae-58552e9e9b0a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:52.536368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843da447-e9a8-4ece-9cb5-dfd9f3174aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:52.537180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843da447-e9a8-4ece-9cb5-dfd9f3174aaf None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:52.537599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843da447-e9a8-4ece-9cb5-dfd9f3174aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:52.537897 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843da447-e9a8-4ece-9cb5-dfd9f3174aaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:52.549302 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843da447-e9a8-4ece-9cb5-dfd9f3174aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:52.550780 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843da447-e9a8-4ece-9cb5-dfd9f3174aaf None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-843da447-e9a8-4ece-9cb5-dfd9f3174aaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:52.568540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:52.574815 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:52.575910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:52.575910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:52.575910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:52.575910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:52.575910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 640/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:52.576192 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1589dc8-5983-4acf-936a-a6515bbf0e7c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:52.686079 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1589dc8-5983-4acf-936a-a6515bbf0e7c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:52.724235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e2bd1-5bf2-4f0b-84b3-7631a25027e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:52.724999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e2bd1-5bf2-4f0b-84b3-7631a25027e4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:52.725375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e2bd1-5bf2-4f0b-84b3-7631a25027e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:52.725665 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e2bd1-5bf2-4f0b-84b3-7631a25027e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:52.726677 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e2bd1-5bf2-4f0b-84b3-7631a25027e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:52.726968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e2bd1-5bf2-4f0b-84b3-7631a25027e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:52.728521 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e2bd1-5bf2-4f0b-84b3-7631a25027e4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:52.742366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 612/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:52.748317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843da447-e9a8-4ece-9cb5-dfd9f3174aaf None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:52.860035 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843da447-e9a8-4ece-9cb5-dfd9f3174aaf None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:52.888512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:52.898324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7a1aa-6cd1-446b-bfa6-da877198d9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:52.899274 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7a1aa-6cd1-446b-bfa6-da877198d9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:52.899634 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7a1aa-6cd1-446b-bfa6-da877198d9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:52.899938 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7a1aa-6cd1-446b-bfa6-da877198d9e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:52.908803 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7a1aa-6cd1-446b-bfa6-da877198d9e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:52.910369 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7a1aa-6cd1-446b-bfa6-da877198d9e2 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-f0e7a1aa-6cd1-446b-bfa6-da877198d9e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:55:52.926871 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:52.928969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:52.931367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:52.931367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:52.931367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:55:52.931367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:55:52.931367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:55:52.931367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:55:52.931367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:55:52.931367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:55:52.931367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:55:52.931367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:52.935912 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 641/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:52.936096 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e2bd1-5bf2-4f0b-84b3-7631a25027e4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:52.997920 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:53.047170 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e2bd1-5bf2-4f0b-84b3-7631a25027e4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:53.085831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24359fbf-3916-4ef2-8812-efbbb5e57df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:53.086550 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24359fbf-3916-4ef2-8812-efbbb5e57df7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:53.086869 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24359fbf-3916-4ef2-8812-efbbb5e57df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:53.087167 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24359fbf-3916-4ef2-8812-efbbb5e57df7 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:53.088157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24359fbf-3916-4ef2-8812-efbbb5e57df7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:53.088490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24359fbf-3916-4ef2-8812-efbbb5e57df7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:53.090028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24359fbf-3916-4ef2-8812-efbbb5e57df7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:53.114640 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 613/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Sun Jul 24 00:55:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:53.115888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7a1aa-6cd1-446b-bfa6-da877198d9e2 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:53.228082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7a1aa-6cd1-446b-bfa6-da877198d9e2 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:53.265559 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ebc54-8e39-49cc-a359-08935307ef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:53.266290 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ebc54-8e39-49cc-a359-08935307ef11 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:53.266627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ebc54-8e39-49cc-a359-08935307ef11 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:53.266890 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ebc54-8e39-49cc-a359-08935307ef11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:53.332840 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:53.350078 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ebc54-8e39-49cc-a359-08935307ef11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:53.351917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ebc54-8e39-49cc-a359-08935307ef11 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:53.464772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 642/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:55:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:55:53.470775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24359fbf-3916-4ef2-8812-efbbb5e57df7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:53.589745 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24359fbf-3916-4ef2-8812-efbbb5e57df7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:53.605865 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:53.631489 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bcb16-8f9e-4c02-9297-fff53205c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:53.632438 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bcb16-8f9e-4c02-9297-fff53205c9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:53.632719 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bcb16-8f9e-4c02-9297-fff53205c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:53.632995 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bcb16-8f9e-4c02-9297-fff53205c9a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:53.644356 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bcb16-8f9e-4c02-9297-fff53205c9a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:53.645869 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bcb16-8f9e-4c02-9297-fff53205c9a8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-768bcb16-8f9e-4c02-9297-fff53205c9a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:53.665174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:53.666368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:53.667488 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:53.667488 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:53.667488 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:53.667488 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:55:53.667488 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 614/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:55:53.672697 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ebc54-8e39-49cc-a359-08935307ef11 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:53.775139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:53.790366 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ebc54-8e39-49cc-a359-08935307ef11 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:53.829288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a43da0-f0bb-47e8-9ee3-e0e0324415a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:53.830066 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a43da0-f0bb-47e8-9ee3-e0e0324415a0 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:53.830353 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a43da0-f0bb-47e8-9ee3-e0e0324415a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:53.830700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a43da0-f0bb-47e8-9ee3-e0e0324415a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:53.831613 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a43da0-f0bb-47e8-9ee3-e0e0324415a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:53.831943 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a43da0-f0bb-47e8-9ee3-e0e0324415a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:53.833544 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a43da0-f0bb-47e8-9ee3-e0e0324415a0 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:53.846616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 643/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:53.852760 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bcb16-8f9e-4c02-9297-fff53205c9a8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:53.965775 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bcb16-8f9e-4c02-9297-fff53205c9a8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:54.002656 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b0dbf-8fb4-4adc-9e41-3d764d4d10df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:54.003543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b0dbf-8fb4-4adc-9e41-3d764d4d10df None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:54.003889 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b0dbf-8fb4-4adc-9e41-3d764d4d10df None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:54.004186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b0dbf-8fb4-4adc-9e41-3d764d4d10df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:54.011432 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b0dbf-8fb4-4adc-9e41-3d764d4d10df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:54.013045 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b0dbf-8fb4-4adc-9e41-3d764d4d10df None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-499b0dbf-8fb4-4adc-9e41-3d764d4d10df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:55:54.028312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:54.029818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:54.030774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:55:54.030774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:55:54.030774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:55:54.030774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:55:54.030774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:55:54.030774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:55:54.030774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:55:54.030774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:55:54.030774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 615/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:54.036189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a43da0-f0bb-47e8-9ee3-e0e0324415a0 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:54.150030 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a43da0-f0bb-47e8-9ee3-e0e0324415a0 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:54.184147 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cd632-b2f5-4d50-b7f4-a6cb8106f186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:54.184819 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd632-b2f5-4d50-b7f4-a6cb8106f186 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:54.185096 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd632-b2f5-4d50-b7f4-a6cb8106f186 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:54.185393 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd632-b2f5-4d50-b7f4-a6cb8106f186 None admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:54.186176 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cd632-b2f5-4d50-b7f4-a6cb8106f186 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:54.186475 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cd632-b2f5-4d50-b7f4-a6cb8106f186 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:54.187901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cd632-b2f5-4d50-b7f4-a6cb8106f186 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:54.200084 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 644/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:55:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:55:54.206715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b0dbf-8fb4-4adc-9e41-3d764d4d10df None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:54.234407 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:54.322408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b0dbf-8fb4-4adc-9e41-3d764d4d10df None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:54.360317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34dca4-290d-4d29-aaac-4dadca9f8fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:54.361033 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34dca4-290d-4d29-aaac-4dadca9f8fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:54.361437 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34dca4-290d-4d29-aaac-4dadca9f8fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:54.361728 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34dca4-290d-4d29-aaac-4dadca9f8fd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:54.362584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34dca4-290d-4d29-aaac-4dadca9f8fd9 None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=cce671a84420484580cfd8efe6a6e227) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:54.362934 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34dca4-290d-4d29-aaac-4dadca9f8fd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:54.364354 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34dca4-290d-4d29-aaac-4dadca9f8fd9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:54.371358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 616/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:55:54 2022] GET /identity/v3/role_assignments?user.id=cce671a84420484580cfd8efe6a6e227&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:56.520221 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a7af7-da6d-4f9a-8350-4e334e47f7e3 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:56.520770 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a7af7-da6d-4f9a-8350-4e334e47f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:56.520770 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a7af7-da6d-4f9a-8350-4e334e47f7e3 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:56.522185 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 645/1261] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:55:56.527810 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98886b1a-fda0-4908-ae10-192e3e851e80 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:56.528317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98886b1a-fda0-4908-ae10-192e3e851e80 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:56.528317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98886b1a-fda0-4908-ae10-192e3e851e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:56.545631 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-98886b1a-fda0-4908-ae10-192e3e851e80 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:55:56.546821 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-98886b1a-fda0-4908-ae10-192e3e851e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:55:56.624085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 617/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:55:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:55:56.646890 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a7af7-da6d-4f9a-8350-4e334e47f7e3 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:56.657964 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:56.751035 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a7af7-da6d-4f9a-8350-4e334e47f7e3 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:56.786549 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a36f50-429e-48da-89c5-4bc54a328a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:56.787270 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a36f50-429e-48da-89c5-4bc54a328a8a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:56.787557 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a36f50-429e-48da-89c5-4bc54a328a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:56.787827 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a36f50-429e-48da-89c5-4bc54a328a8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:56.798797 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a36f50-429e-48da-89c5-4bc54a328a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-10a36f50-429e-48da-89c5-4bc54a328a8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:55:56.806594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:56.807654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:56.808756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 646/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:55:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:56.814000 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98886b1a-fda0-4908-ae10-192e3e851e80 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:56.835874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:56.922853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98886b1a-fda0-4908-ae10-192e3e851e80 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:56.958083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2f0b9-f174-452c-a513-adc7d760122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:56.958752 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2f0b9-f174-452c-a513-adc7d760122e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:56.959031 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2f0b9-f174-452c-a513-adc7d760122e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:56.959300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2f0b9-f174-452c-a513-adc7d760122e None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:56.960089 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2f0b9-f174-452c-a513-adc7d760122e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:56.960399 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2f0b9-f174-452c-a513-adc7d760122e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:56.961801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2f0b9-f174-452c-a513-adc7d760122e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:56.969965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 618/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:55:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:56.978731 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a36f50-429e-48da-89c5-4bc54a328a8a None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:57.047565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:57.083306 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a36f50-429e-48da-89c5-4bc54a328a8a None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:57.128452 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29b571-cc85-4cfb-a0b8-778ae07c426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:57.129251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29b571-cc85-4cfb-a0b8-778ae07c426d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:57.129565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29b571-cc85-4cfb-a0b8-778ae07c426d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:57.129836 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29b571-cc85-4cfb-a0b8-778ae07c426d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:57.141134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29b571-cc85-4cfb-a0b8-778ae07c426d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:57.142651 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29b571-cc85-4cfb-a0b8-778ae07c426d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-8a29b571-cc85-4cfb-a0b8-778ae07c426d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:57.159831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:57.160809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:57.161809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:57.161809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:57.161809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:57.161809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:57.161809 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 647/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:57.167854 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2f0b9-f174-452c-a513-adc7d760122e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:57.251965 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:57.280475 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2f0b9-f174-452c-a513-adc7d760122e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:57.320193 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438113bd-6eb2-4d3e-ba3c-72c621686947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:57.321068 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438113bd-6eb2-4d3e-ba3c-72c621686947 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:57.321526 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438113bd-6eb2-4d3e-ba3c-72c621686947 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:57.321915 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438113bd-6eb2-4d3e-ba3c-72c621686947 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:57.322926 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438113bd-6eb2-4d3e-ba3c-72c621686947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:57.323299 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438113bd-6eb2-4d3e-ba3c-72c621686947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:57.325603 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438113bd-6eb2-4d3e-ba3c-72c621686947 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:57.341687 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 619/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:55:57.347623 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29b571-cc85-4cfb-a0b8-778ae07c426d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:57.458443 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29b571-cc85-4cfb-a0b8-778ae07c426d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:57.478433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:57.497570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b76405-7c80-40bf-b2e1-f0e7adc2a34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:57.498392 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76405-7c80-40bf-b2e1-f0e7adc2a34d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:57.498674 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76405-7c80-40bf-b2e1-f0e7adc2a34d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:57.498952 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76405-7c80-40bf-b2e1-f0e7adc2a34d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:57.506517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b76405-7c80-40bf-b2e1-f0e7adc2a34d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:57.507996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b76405-7c80-40bf-b2e1-f0e7adc2a34d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-86b76405-7c80-40bf-b2e1-f0e7adc2a34d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:55:57.522110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:57.523521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:57.524554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:57.524554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:57.524554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:55:57.524554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:55:57.524554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:55:57.524554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:55:57.524554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:55:57.524554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:55:57.524554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:55:57.524554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:57.524554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 648/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:57.531767 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438113bd-6eb2-4d3e-ba3c-72c621686947 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:57.646896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438113bd-6eb2-4d3e-ba3c-72c621686947 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:57.679948 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba5ead-9a67-407c-96e8-ed02d37739eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:57.680607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba5ead-9a67-407c-96e8-ed02d37739eb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:57.680887 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba5ead-9a67-407c-96e8-ed02d37739eb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:57.681155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba5ead-9a67-407c-96e8-ed02d37739eb None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:57.682031 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba5ead-9a67-407c-96e8-ed02d37739eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:57.682338 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba5ead-9a67-407c-96e8-ed02d37739eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:57.683877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba5ead-9a67-407c-96e8-ed02d37739eb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:57.692611 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:57.701504 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 620/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Sun Jul 24 00:55:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:57.707831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b76405-7c80-40bf-b2e1-f0e7adc2a34d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:57.815637 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b76405-7c80-40bf-b2e1-f0e7adc2a34d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:57.851239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c5e5b-3d0f-45d9-90c6-4d97650957ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:57.851968 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c5e5b-3d0f-45d9-90c6-4d97650957ba None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:57.852259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c5e5b-3d0f-45d9-90c6-4d97650957ba None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:57.852524 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c5e5b-3d0f-45d9-90c6-4d97650957ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:57.863229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c5e5b-3d0f-45d9-90c6-4d97650957ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:57.864696 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c5e5b-3d0f-45d9-90c6-4d97650957ba None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-ae4c5e5b-3d0f-45d9-90c6-4d97650957ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:57.881684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:57.882798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:57.883941 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:57.883941 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:57.883941 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:57.883941 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:57.883941 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 649/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:57.890356 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba5ead-9a67-407c-96e8-ed02d37739eb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:57.988693 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba5ead-9a67-407c-96e8-ed02d37739eb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:58.024530 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2fb01-e905-4d53-87a0-64b0354268f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:58.025174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2fb01-e905-4d53-87a0-64b0354268f3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:58.025483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2fb01-e905-4d53-87a0-64b0354268f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:58.025753 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2fb01-e905-4d53-87a0-64b0354268f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:58.026471 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2fb01-e905-4d53-87a0-64b0354268f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:58.026770 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2fb01-e905-4d53-87a0-64b0354268f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:58.028140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2fb01-e905-4d53-87a0-64b0354268f3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:58.039520 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 621/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:58.045281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c5e5b-3d0f-45d9-90c6-4d97650957ba None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:58.079645 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:58.151086 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c5e5b-3d0f-45d9-90c6-4d97650957ba None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:58.186924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54c290-5351-4b92-8b7a-644487f0244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:58.187707 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54c290-5351-4b92-8b7a-644487f0244b None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:58.187988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54c290-5351-4b92-8b7a-644487f0244b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:58.188257 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54c290-5351-4b92-8b7a-644487f0244b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:58.195448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54c290-5351-4b92-8b7a-644487f0244b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:58.196884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54c290-5351-4b92-8b7a-644487f0244b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-ca54c290-5351-4b92-8b7a-644487f0244b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:55:58.211665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:58.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:58.213690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:55:58.213690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:55:58.213690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:55:58.213690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:55:58.213690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:55:58.213690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:55:58.213690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:55:58.213690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:55:58.213690 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 650/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:55:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:58.220972 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2fb01-e905-4d53-87a0-64b0354268f3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:58.284413 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:58.334064 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2fb01-e905-4d53-87a0-64b0354268f3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:58.371448 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde52ca-7108-420a-859d-c55796b9e2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:58.372112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde52ca-7108-420a-859d-c55796b9e2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:58.372393 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde52ca-7108-420a-859d-c55796b9e2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:58.372667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde52ca-7108-420a-859d-c55796b9e2c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:58.373486 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde52ca-7108-420a-859d-c55796b9e2c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:58.373795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde52ca-7108-420a-859d-c55796b9e2c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:58.375236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde52ca-7108-420a-859d-c55796b9e2c5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:58.388187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 622/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:55:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:58.394591 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54c290-5351-4b92-8b7a-644487f0244b None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:58.488466 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:58.498111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54c290-5351-4b92-8b7a-644487f0244b None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:58.544424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecee18-cc4c-4d82-bf38-a6b121693e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:58.545351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecee18-cc4c-4d82-bf38-a6b121693e5d None admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:58.545633 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecee18-cc4c-4d82-bf38-a6b121693e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:58.545908 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecee18-cc4c-4d82-bf38-a6b121693e5d None admin] PATH_INFO: `/v3/projects/f5b7f081bd694cce90cca76194df476e/users/cce671a84420484580cfd8efe6a6e227/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:58.547961 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecee18-cc4c-4d82-bf38-a6b121693e5d None admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7f081bd694cce90cca76194df476e, user_id=cce671a84420484580cfd8efe6a6e227, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:58.549436 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecee18-cc4c-4d82-bf38-a6b121693e5d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:58.564883 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 651/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Jul 24 00:55:58 2022] PUT /identity/v3/projects/f5b7f081bd694cce90cca76194df476e/users/cce671a84420484580cfd8efe6a6e227/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:56:00.544880 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecda37-488f-4dfb-af8b-0639c7caef2d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:00.545804 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecda37-488f-4dfb-af8b-0639c7caef2d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:00.545804 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecda37-488f-4dfb-af8b-0639c7caef2d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:00.548074 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 623/1274] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:56:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:56:00.556708 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf389e3-7aa0-4800-b36c-f8f85482734d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:00.557125 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf389e3-7aa0-4800-b36c-f8f85482734d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:00.557314 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf389e3-7aa0-4800-b36c-f8f85482734d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:00.579786 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-ebf389e3-7aa0-4800-b36c-f8f85482734d None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:00.580999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ebf389e3-7aa0-4800-b36c-f8f85482734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:00.660852 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 652/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:56:00.684521 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecda37-488f-4dfb-af8b-0639c7caef2d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:00.810504 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecda37-488f-4dfb-af8b-0639c7caef2d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:00.830363 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:00.848586 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c7c71-a384-47d4-87f9-8e5fbd435858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:00.849421 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c7c71-a384-47d4-87f9-8e5fbd435858 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:00.849700 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c7c71-a384-47d4-87f9-8e5fbd435858 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:00.849978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c7c71-a384-47d4-87f9-8e5fbd435858 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:00.860762 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c7c71-a384-47d4-87f9-8e5fbd435858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-854c7c71-a384-47d4-87f9-8e5fbd435858 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:56:00.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:00.869580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:56:00.870968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 624/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Jul 24 00:56:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:00.879545 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf389e3-7aa0-4800-b36c-f8f85482734d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:00.971076 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:00.992806 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf389e3-7aa0-4800-b36c-f8f85482734d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:01.026311 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7176ea-b047-4ddb-8adf-cd52381b3f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:01.028176 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7176ea-b047-4ddb-8adf-cd52381b3f65 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:01.028176 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7176ea-b047-4ddb-8adf-cd52381b3f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:01.028176 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7176ea-b047-4ddb-8adf-cd52381b3f65 None admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:01.028456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7176ea-b047-4ddb-8adf-cd52381b3f65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:01.028549 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7176ea-b047-4ddb-8adf-cd52381b3f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:01.029927 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7176ea-b047-4ddb-8adf-cd52381b3f65 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:01.038172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 653/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Jul 24 00:56:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:01.047697 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c7c71-a384-47d4-87f9-8e5fbd435858 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:01.170746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c7c71-a384-47d4-87f9-8e5fbd435858 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:01.208467 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa76a0-77cc-42da-87e0-a8904a25aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:01.209296 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa76a0-77cc-42da-87e0-a8904a25aa87 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:01.209572 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa76a0-77cc-42da-87e0-a8904a25aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:01.209846 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa76a0-77cc-42da-87e0-a8904a25aa87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:01.221526 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa76a0-77cc-42da-87e0-a8904a25aa87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:01.222979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa76a0-77cc-42da-87e0-a8904a25aa87 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-55aa76a0-77cc-42da-87e0-a8904a25aa87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:56:01.241043 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:01.242116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:01.247032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:56:01.247032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:56:01.247032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:01.247032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:56:01.247032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 625/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:01.251849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7176ea-b047-4ddb-8adf-cd52381b3f65 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:01.376175 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7176ea-b047-4ddb-8adf-cd52381b3f65 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:01.414054 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4719e-5a4e-4ba9-a88d-9582be5afb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:01.414721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4719e-5a4e-4ba9-a88d-9582be5afb19 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:01.415006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4719e-5a4e-4ba9-a88d-9582be5afb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:01.415289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4719e-5a4e-4ba9-a88d-9582be5afb19 None admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:01.416015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4719e-5a4e-4ba9-a88d-9582be5afb19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:01.416325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4719e-5a4e-4ba9-a88d-9582be5afb19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:01.417740 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4719e-5a4e-4ba9-a88d-9582be5afb19 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:01.429998 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 654/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:01.439023 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa76a0-77cc-42da-87e0-a8904a25aa87 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:01.479006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:01.553475 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa76a0-77cc-42da-87e0-a8904a25aa87 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:01.590073 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245676f-1a5a-436b-a810-c08f61ef657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:01.590884 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245676f-1a5a-436b-a810-c08f61ef657e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:01.591160 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245676f-1a5a-436b-a810-c08f61ef657e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:01.591434 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245676f-1a5a-436b-a810-c08f61ef657e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:01.599187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245676f-1a5a-436b-a810-c08f61ef657e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:01.600637 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245676f-1a5a-436b-a810-c08f61ef657e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-1245676f-1a5a-436b-a810-c08f61ef657e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:56:01.615159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:01.616368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:01.617692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:01.617692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:01.617692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:56:01.617692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:56:01.617692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:56:01.617692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:56:01.617692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:56:01.617692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:56:01.617692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:56:01.617692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:56:01.621285 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 626/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:01.623145 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4719e-5a4e-4ba9-a88d-9582be5afb19 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:01.629290 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:01.733547 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4719e-5a4e-4ba9-a88d-9582be5afb19 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:01.771044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8562d-380e-4509-8722-b026f9008a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:01.771708 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8562d-380e-4509-8722-b026f9008a8f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:01.771990 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8562d-380e-4509-8722-b026f9008a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:01.772264 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8562d-380e-4509-8722-b026f9008a8f None admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:01.773137 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8562d-380e-4509-8722-b026f9008a8f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:01.773478 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8562d-380e-4509-8722-b026f9008a8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:01.774909 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8562d-380e-4509-8722-b026f9008a8f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:01.792037 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 655/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Sun Jul 24 00:56:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:01.798853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245676f-1a5a-436b-a810-c08f61ef657e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:01.899913 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:01.910542 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245676f-1a5a-436b-a810-c08f61ef657e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:01.945116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a7766-9b16-4c85-8487-e227c07fdc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:01.945793 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a7766-9b16-4c85-8487-e227c07fdc16 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:01.946074 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a7766-9b16-4c85-8487-e227c07fdc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:01.946342 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a7766-9b16-4c85-8487-e227c07fdc16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:02.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a7766-9b16-4c85-8487-e227c07fdc16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:02.015450 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a7766-9b16-4c85-8487-e227c07fdc16 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:02.107469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:02.119278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 627/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Jul 24 00:56:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:56:02.125249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8562d-380e-4509-8722-b026f9008a8f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:02.188645 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:02.234708 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8562d-380e-4509-8722-b026f9008a8f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:02.272319 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20067d-0dcc-46f2-a7de-467ea58f4941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:02.273082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20067d-0dcc-46f2-a7de-467ea58f4941 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:02.273465 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20067d-0dcc-46f2-a7de-467ea58f4941 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:02.273739 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20067d-0dcc-46f2-a7de-467ea58f4941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:02.284170 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20067d-0dcc-46f2-a7de-467ea58f4941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:02.285653 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20067d-0dcc-46f2-a7de-467ea58f4941 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-6a20067d-0dcc-46f2-a7de-467ea58f4941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:56:02.309570 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:02.310494 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:02.311502 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:56:02.311502 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:56:02.311502 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:02.311502 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:56:02.311502 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 656/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:02.318744 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a7766-9b16-4c85-8487-e227c07fdc16 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:02.425537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a7766-9b16-4c85-8487-e227c07fdc16 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:02.464313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a2640-dbfd-44ad-9f8a-6fa8581895ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:02.464950 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a2640-dbfd-44ad-9f8a-6fa8581895ab None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:02.465232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a2640-dbfd-44ad-9f8a-6fa8581895ab None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:02.465608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a2640-dbfd-44ad-9f8a-6fa8581895ab None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:02.466401 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a2640-dbfd-44ad-9f8a-6fa8581895ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:02.466732 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a2640-dbfd-44ad-9f8a-6fa8581895ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:02.468345 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a2640-dbfd-44ad-9f8a-6fa8581895ab None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:02.479684 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 628/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Jul 24 00:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:02.485736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20067d-0dcc-46f2-a7de-467ea58f4941 None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:02.608720 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20067d-0dcc-46f2-a7de-467ea58f4941 None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:02.623227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:02.645473 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0978d26-0418-4eea-9dfa-e42afbae416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:02.646280 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0978d26-0418-4eea-9dfa-e42afbae416f None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:02.646558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0978d26-0418-4eea-9dfa-e42afbae416f None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:02.646830 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0978d26-0418-4eea-9dfa-e42afbae416f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:02.653749 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0978d26-0418-4eea-9dfa-e42afbae416f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:02.655201 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0978d26-0418-4eea-9dfa-e42afbae416f None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application [None req-a0978d26-0418-4eea-9dfa-e42afbae416f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:56:02.669823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:02.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:02.671791 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:56:02.671791 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:56:02.671791 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:56:02.671791 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:56:02.671791 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:56:02.671791 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:56:02.671791 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:56:02.671791 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: ERROR keystone.server.flask.application Jul 24 00:56:02.673390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 657/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Jul 24 00:56:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:02.677032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a2640-dbfd-44ad-9f8a-6fa8581895ab None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:02.728613 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:02.780553 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a2640-dbfd-44ad-9f8a-6fa8581895ab None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:02.815517 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3631b-a596-45a9-98ad-5438a5342027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:02.816175 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3631b-a596-45a9-98ad-5438a5342027 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:02.816455 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3631b-a596-45a9-98ad-5438a5342027 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:02.816729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3631b-a596-45a9-98ad-5438a5342027 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:02.817556 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3631b-a596-45a9-98ad-5438a5342027 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:02.817870 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3631b-a596-45a9-98ad-5438a5342027 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:02.819314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3631b-a596-45a9-98ad-5438a5342027 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:02.832258 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 629/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Jul 24 00:56:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:02.838773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0978d26-0418-4eea-9dfa-e42afbae416f None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:02.944089 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0978d26-0418-4eea-9dfa-e42afbae416f None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:02.984771 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5298ee-b67d-46e1-b830-552a732514c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:02.985778 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5298ee-b67d-46e1-b830-552a732514c6 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:02.986153 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5298ee-b67d-46e1-b830-552a732514c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:02.986510 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5298ee-b67d-46e1-b830-552a732514c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:02.987789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5298ee-b67d-46e1-b830-552a732514c6 None admin] RBAC: Adding query filter params (role.id=463fec8fb3fb46febb7e7cc6952f61ad, scope.project.id=f5b7f081bd694cce90cca76194df476e, user.id=cce671a84420484580cfd8efe6a6e227) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:02.988213 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5298ee-b67d-46e1-b830-552a732514c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:02.990482 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5298ee-b67d-46e1-b830-552a732514c6 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:02.997363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 658/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Jul 24 00:56:02 2022] GET /identity/v3/role_assignments?user.id=cce671a84420484580cfd8efe6a6e227&scope.project.id=f5b7f081bd694cce90cca76194df476e&role.id=463fec8fb3fb46febb7e7cc6952f61ad => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:05.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417d7a2-164a-46ec-a99a-abbef7fc6b81 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:05.027529 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417d7a2-164a-46ec-a99a-abbef7fc6b81 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:05.027529 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417d7a2-164a-46ec-a99a-abbef7fc6b81 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:05.029829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 630/1288] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:56:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:56:05.035910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d983b8-aa9f-4bf0-a98c-095ac68fc333 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:05.036357 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d983b8-aa9f-4bf0-a98c-095ac68fc333 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:05.036484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d983b8-aa9f-4bf0-a98c-095ac68fc333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:05.056114 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c8d983b8-aa9f-4bf0-a98c-095ac68fc333 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:05.057356 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c8d983b8-aa9f-4bf0-a98c-095ac68fc333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:05.091845 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:05.144524 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 659/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:56:05.168399 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417d7a2-164a-46ec-a99a-abbef7fc6b81 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:05.295767 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417d7a2-164a-46ec-a99a-abbef7fc6b81 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:05.308724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:05.337773 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd248d-a7a9-45b6-b8c6-4a0e62403833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:05.338618 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd248d-a7a9-45b6-b8c6-4a0e62403833 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:05.338967 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd248d-a7a9-45b6-b8c6-4a0e62403833 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:05.339318 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd248d-a7a9-45b6-b8c6-4a0e62403833 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:05.340005 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd248d-a7a9-45b6-b8c6-4a0e62403833 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:05.341676 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd248d-a7a9-45b6-b8c6-4a0e62403833 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-effd248d-a7a9-45b6-b8c6-4a0e62403833 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:05.356149 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:05.357650 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:56:05.358785 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 631/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Jul 24 00:56:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:05.364086 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d983b8-aa9f-4bf0-a98c-095ac68fc333 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:05.466477 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d983b8-aa9f-4bf0-a98c-095ac68fc333 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:05.509683 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4e945-1fba-4d6d-9c8b-6256a03d6bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:05.510354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4e945-1fba-4d6d-9c8b-6256a03d6bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:05.510642 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4e945-1fba-4d6d-9c8b-6256a03d6bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:05.510918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4e945-1fba-4d6d-9c8b-6256a03d6bf5 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:05.511632 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4e945-1fba-4d6d-9c8b-6256a03d6bf5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:05.511959 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4e945-1fba-4d6d-9c8b-6256a03d6bf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:05.513388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4e945-1fba-4d6d-9c8b-6256a03d6bf5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:05.518610 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 660/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Sun Jul 24 00:56:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:05.524641 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd248d-a7a9-45b6-b8c6-4a0e62403833 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:05.641512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd248d-a7a9-45b6-b8c6-4a0e62403833 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:05.683661 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe309f0-46e5-4400-be62-5c16bf92bbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:05.684324 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe309f0-46e5-4400-be62-5c16bf92bbab None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:05.684604 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe309f0-46e5-4400-be62-5c16bf92bbab None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:05.684878 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe309f0-46e5-4400-be62-5c16bf92bbab None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:05.685624 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe309f0-46e5-4400-be62-5c16bf92bbab None admin] RBAC: Adding query filter params (type=placement) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:05.685943 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe309f0-46e5-4400-be62-5c16bf92bbab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:05.687326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe309f0-46e5-4400-be62-5c16bf92bbab None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:05.692551 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 632/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Sun Jul 24 00:56:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:07.693115 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e3841-c5b2-42c7-afab-2298079dcdc4 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:07.694080 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e3841-c5b2-42c7-afab-2298079dcdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:07.694256 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e3841-c5b2-42c7-afab-2298079dcdc4 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:07.699090 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 661/1293] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:56:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:56:07.706137 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acce27-78f8-456c-abea-6f78354d342e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:07.706892 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acce27-78f8-456c-abea-6f78354d342e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:07.707052 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acce27-78f8-456c-abea-6f78354d342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:07.727475 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-48acce27-78f8-456c-abea-6f78354d342e None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:07.728693 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-48acce27-78f8-456c-abea-6f78354d342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:07.761167 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:07.800926 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 633/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:56:07.824626 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e3841-c5b2-42c7-afab-2298079dcdc4 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:07.858907 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:07.941753 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e3841-c5b2-42c7-afab-2298079dcdc4 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:07.976928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdc510-afe1-4a99-9c1f-63e86ba96c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:07.977612 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdc510-afe1-4a99-9c1f-63e86ba96c0b None admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:07.977900 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdc510-afe1-4a99-9c1f-63e86ba96c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:07.978180 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdc510-afe1-4a99-9c1f-63e86ba96c0b None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:07.978900 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdc510-afe1-4a99-9c1f-63e86ba96c0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:07.980277 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdc510-afe1-4a99-9c1f-63e86ba96c0b None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:07.997081 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 662/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Jul 24 00:56:07 2022] POST /identity/v3/services => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:56:10.052359 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a6385-5f60-4e84-a1dd-5a39983f1482 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:10.052944 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a6385-5f60-4e84-a1dd-5a39983f1482 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:10.052944 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a6385-5f60-4e84-a1dd-5a39983f1482 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:10.054368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 634/1296] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:56:10.060682 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e48512-6f1d-4def-b834-4c80cd16a6a7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:10.061439 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e48512-6f1d-4def-b834-4c80cd16a6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:10.061598 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e48512-6f1d-4def-b834-4c80cd16a6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:10.083183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-47e48512-6f1d-4def-b834-4c80cd16a6a7 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:10.084398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-47e48512-6f1d-4def-b834-4c80cd16a6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:10.168991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 663/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:56:10.192012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a6385-5f60-4e84-a1dd-5a39983f1482 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:10.309021 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a6385-5f60-4e84-a1dd-5a39983f1482 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:10.347144 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7167e43-f1c9-4204-9f70-f907df07d022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:10.347930 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7167e43-f1c9-4204-9f70-f907df07d022 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:10.348206 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7167e43-f1c9-4204-9f70-f907df07d022 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:10.348474 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7167e43-f1c9-4204-9f70-f907df07d022 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:10.349125 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7167e43-f1c9-4204-9f70-f907df07d022 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:10.350531 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7167e43-f1c9-4204-9f70-f907df07d022 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c7167e43-f1c9-4204-9f70-f907df07d022 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:10.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:10.363416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:56:10.364367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 635/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Jul 24 00:56:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:10.370026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e48512-6f1d-4def-b834-4c80cd16a6a7 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:10.391621 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:10.480637 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e48512-6f1d-4def-b834-4c80cd16a6a7 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:10.516410 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03476de-d8f1-4ef8-824b-b8dfeadf8d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:10.517072 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03476de-d8f1-4ef8-824b-b8dfeadf8d8d None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:10.517386 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03476de-d8f1-4ef8-824b-b8dfeadf8d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:10.517657 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03476de-d8f1-4ef8-824b-b8dfeadf8d8d None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:10.518362 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03476de-d8f1-4ef8-824b-b8dfeadf8d8d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:10.518668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03476de-d8f1-4ef8-824b-b8dfeadf8d8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:10.520059 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03476de-d8f1-4ef8-824b-b8dfeadf8d8d None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:10.525695 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 664/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Sun Jul 24 00:56:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:10.532009 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7167e43-f1c9-4204-9f70-f907df07d022 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:10.568151 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:10.638935 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7167e43-f1c9-4204-9f70-f907df07d022 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:10.673761 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de90e5-b502-4e01-8899-397daa6d38f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:10.674413 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de90e5-b502-4e01-8899-397daa6d38f2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:10.674694 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de90e5-b502-4e01-8899-397daa6d38f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:10.674969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de90e5-b502-4e01-8899-397daa6d38f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:10.675765 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de90e5-b502-4e01-8899-397daa6d38f2 None admin] RBAC: Adding query filter params (interface=public, service_id=392e7e4190be4b7e9ba7ebf427dd2d0f, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:10.676072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de90e5-b502-4e01-8899-397daa6d38f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:10.677486 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de90e5-b502-4e01-8899-397daa6d38f2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:10.682722 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 636/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Jul 24 00:56:10 2022] GET /identity/v3/endpoints?service_id=392e7e4190be4b7e9ba7ebf427dd2d0f&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:10.688589 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03476de-d8f1-4ef8-824b-b8dfeadf8d8d None admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:10.778583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:10.800660 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03476de-d8f1-4ef8-824b-b8dfeadf8d8d None admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:10.836483 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04e230-35ac-48bd-b9f9-6e1f8ab7637a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:10.837072 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04e230-35ac-48bd-b9f9-6e1f8ab7637a None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:10.837380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04e230-35ac-48bd-b9f9-6e1f8ab7637a None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:10.837649 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04e230-35ac-48bd-b9f9-6e1f8ab7637a None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:10.838322 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04e230-35ac-48bd-b9f9-6e1f8ab7637a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:10.839697 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04e230-35ac-48bd-b9f9-6e1f8ab7637a None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:10.846985 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 665/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Jul 24 00:56:10 2022] GET /identity/v3/services => generated 2191 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 00:56:12.821532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910d8ed-38d4-46ef-8b4c-af9c2e65ffd4 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:12.822084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910d8ed-38d4-46ef-8b4c-af9c2e65ffd4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:12.822212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910d8ed-38d4-46ef-8b4c-af9c2e65ffd4 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:12.824269 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 637/1302] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:56:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:56:12.832624 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494feeb-2c4a-4fef-b974-0adcac17714c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:12.833067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494feeb-2c4a-4fef-b974-0adcac17714c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:12.833158 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494feeb-2c4a-4fef-b974-0adcac17714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:12.850905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-5494feeb-2c4a-4fef-b974-0adcac17714c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:12.852008 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5494feeb-2c4a-4fef-b974-0adcac17714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:12.922963 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 666/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:56:12.948309 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910d8ed-38d4-46ef-8b4c-af9c2e65ffd4 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:13.049001 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:13.056973 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910d8ed-38d4-46ef-8b4c-af9c2e65ffd4 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:13.093314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bc935-231a-457c-85dd-d17615ac3a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:13.094107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bc935-231a-457c-85dd-d17615ac3a96 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:13.094386 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bc935-231a-457c-85dd-d17615ac3a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:13.094661 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bc935-231a-457c-85dd-d17615ac3a96 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:13.095313 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bc935-231a-457c-85dd-d17615ac3a96 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:13.096695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bc935-231a-457c-85dd-d17615ac3a96 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c36bc935-231a-457c-85dd-d17615ac3a96 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:13.108622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:13.109997 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Jul 24 00:56:13.111146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 638/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Jul 24 00:56:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:13.116741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494feeb-2c4a-4fef-b974-0adcac17714c None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:13.205281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:13.230877 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494feeb-2c4a-4fef-b974-0adcac17714c None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:13.265939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6bf32-c1ad-428a-a881-8f4ce69de5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:13.266603 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6bf32-c1ad-428a-a881-8f4ce69de5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:13.266914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6bf32-c1ad-428a-a881-8f4ce69de5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:13.267162 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6bf32-c1ad-428a-a881-8f4ce69de5b5 None admin] PATH_INFO: `/v3/services` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:13.267866 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6bf32-c1ad-428a-a881-8f4ce69de5b5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:13.268170 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6bf32-c1ad-428a-a881-8f4ce69de5b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:13.269564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6bf32-c1ad-428a-a881-8f4ce69de5b5 None admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:13.274825 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 667/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Sun Jul 24 00:56:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:13.281445 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bc935-231a-457c-85dd-d17615ac3a96 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:13.401386 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bc935-231a-457c-85dd-d17615ac3a96 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:13.435929 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20133554-5c54-4992-9cfe-35aeda30fb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:13.436587 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20133554-5c54-4992-9cfe-35aeda30fb8a None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:13.436867 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20133554-5c54-4992-9cfe-35aeda30fb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:13.437141 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20133554-5c54-4992-9cfe-35aeda30fb8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:13.437909 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20133554-5c54-4992-9cfe-35aeda30fb8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:13.439297 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20133554-5c54-4992-9cfe-35aeda30fb8a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:13.468302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 639/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Jul 24 00:56:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:56:23.272086 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=30 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:23.463578 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:16.127989 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f5e35-ad2b-4b77-b2d3-85ffc1afedd3 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:16.128597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f5e35-ad2b-4b77-b2d3-85ffc1afedd3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:16.128597 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f5e35-ad2b-4b77-b2d3-85ffc1afedd3 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:16.133933 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 668/1307] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:16.135373 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bb58f-df7a-4a44-a28b-c5ef3cf9eae8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:16.135818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bb58f-df7a-4a44-a28b-c5ef3cf9eae8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:16.135902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bb58f-df7a-4a44-a28b-c5ef3cf9eae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:16.217523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-dc8bb58f-df7a-4a44-a28b-c5ef3cf9eae8 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:16.219151 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-dc8bb58f-df7a-4a44-a28b-c5ef3cf9eae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:16.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 640/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:16.410329 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635d81b-301f-4b3c-8a8d-422cfd2d71b5 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:16.410889 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635d81b-301f-4b3c-8a8d-422cfd2d71b5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:16.411398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635d81b-301f-4b3c-8a8d-422cfd2d71b5 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:16.413896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 669/1309] 10.222.0.43 () {54 vars in 965 bytes} [Sun Jul 24 00:57:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:16.424406 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce363-3185-4734-823f-303b715157b0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:16.425911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce363-3185-4734-823f-303b715157b0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:16.427285 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce363-3185-4734-823f-303b715157b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:16.567200 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-be5ce363-3185-4734-823f-303b715157b0 None None] MFA Rules not processed for user `e0dae91953bf4a84883723bf3639e377`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:16.568533 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-be5ce363-3185-4734-823f-303b715157b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:16.592312 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:16.660822 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 641/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Sun Jul 24 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:57:16.670220 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635d81b-301f-4b3c-8a8d-422cfd2d71b5 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:16.672043 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f635d81b-301f-4b3c-8a8d-422cfd2d71b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:16.793038 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635d81b-301f-4b3c-8a8d-422cfd2d71b5 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:16.872843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e971a5-36eb-4b83-9c35-da27d0ea4f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:16.873811 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e971a5-36eb-4b83-9c35-da27d0ea4f7e service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:16.874235 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e971a5-36eb-4b83-9c35-da27d0ea4f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:16.874671 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e971a5-36eb-4b83-9c35-da27d0ea4f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:16.876460 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-14e971a5-36eb-4b83-9c35-da27d0ea4f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:16.936533 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:16.999484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e971a5-36eb-4b83-9c35-da27d0ea4f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:17.001090 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e971a5-36eb-4b83-9c35-da27d0ea4f7e service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:17.024325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 670/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:19.379446 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a02f4d-10ac-4680-b49d-bf1a9aaef90b None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:19.379978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a02f4d-10ac-4680-b49d-bf1a9aaef90b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:19.379978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a02f4d-10ac-4680-b49d-bf1a9aaef90b None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:19.383630 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 642/1312] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:19.386829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb86d2c-3de2-4034-9f1e-ef5f6391e923 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:19.387303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb86d2c-3de2-4034-9f1e-ef5f6391e923 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:19.387618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb86d2c-3de2-4034-9f1e-ef5f6391e923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:19.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6cb86d2c-3de2-4034-9f1e-ef5f6391e923 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:19.476103 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6cb86d2c-3de2-4034-9f1e-ef5f6391e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:19.605336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 671/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:19.640053 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a02f4d-10ac-4680-b49d-bf1a9aaef90b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:19.641790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-14a02f4d-10ac-4680-b49d-bf1a9aaef90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:19.763236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a02f4d-10ac-4680-b49d-bf1a9aaef90b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:19.847053 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973a989-5f6c-4b6b-a19a-49ccaffc736b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:19.847867 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973a989-5f6c-4b6b-a19a-49ccaffc736b service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:19.848257 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973a989-5f6c-4b6b-a19a-49ccaffc736b service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:19.852278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973a989-5f6c-4b6b-a19a-49ccaffc736b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:19.853391 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:19.855179 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1973a989-5f6c-4b6b-a19a-49ccaffc736b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:19.975074 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973a989-5f6c-4b6b-a19a-49ccaffc736b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:19.976603 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973a989-5f6c-4b6b-a19a-49ccaffc736b service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:19.995126 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 643/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:22.351615 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c75d8-46ca-49f9-9250-49fa0d108319 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:22.352151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c75d8-46ca-49f9-9250-49fa0d108319 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:22.352151 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c75d8-46ca-49f9-9250-49fa0d108319 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:22.353504 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 672/1315] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:22.359876 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d91e0-efa9-4c0c-898e-98c4811493a0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:22.360352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d91e0-efa9-4c0c-898e-98c4811493a0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:22.360461 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d91e0-efa9-4c0c-898e-98c4811493a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:22.431606 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0d8d91e0-efa9-4c0c-898e-98c4811493a0 None None] MFA Rules not processed for user `21b09299f25d4591a38f3b193aad3d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:22.432806 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0d8d91e0-efa9-4c0c-898e-98c4811493a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:22.485468 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:22.532491 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 644/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:22.573914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c75d8-46ca-49f9-9250-49fa0d108319 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:22.575944 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9c7c75d8-46ca-49f9-9250-49fa0d108319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:22.588076 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:22.697014 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c75d8-46ca-49f9-9250-49fa0d108319 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:22.786226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee27c1-1ced-484b-b038-f6802ed60c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:22.787068 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee27c1-1ced-484b-b038-f6802ed60c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:22.787433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee27c1-1ced-484b-b038-f6802ed60c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:22.787850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee27c1-1ced-484b-b038-f6802ed60c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:22.789533 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d3ee27c1-1ced-484b-b038-f6802ed60c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:22.856816 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:22.912554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee27c1-1ced-484b-b038-f6802ed60c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:22.914082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee27c1-1ced-484b-b038-f6802ed60c68 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:22.932058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 673/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:25.536493 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102444f-da8f-4814-b832-76ee9065033f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:25.537107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102444f-da8f-4814-b832-76ee9065033f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:25.537107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102444f-da8f-4814-b832-76ee9065033f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:25.538504 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 645/1318] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:25.545026 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e88e54-a4ec-41ac-9eac-901946a66e85 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:25.545509 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e88e54-a4ec-41ac-9eac-901946a66e85 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:25.545640 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e88e54-a4ec-41ac-9eac-901946a66e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:25.627774 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-53e88e54-a4ec-41ac-9eac-901946a66e85 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:25.628994 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-53e88e54-a4ec-41ac-9eac-901946a66e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:25.733947 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 674/1319] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:25.778032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102444f-da8f-4814-b832-76ee9065033f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:25.780520 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e102444f-da8f-4814-b832-76ee9065033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:25.898396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102444f-da8f-4814-b832-76ee9065033f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:25.973969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24564ec8-7b68-478b-8038-9067259e3c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:25.974622 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564ec8-7b68-478b-8038-9067259e3c7b service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:25.974902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564ec8-7b68-478b-8038-9067259e3c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:25.975185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564ec8-7b68-478b-8038-9067259e3c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:25.976916 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-24564ec8-7b68-478b-8038-9067259e3c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:25.984430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:26.095418 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24564ec8-7b68-478b-8038-9067259e3c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:26.096877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24564ec8-7b68-478b-8038-9067259e3c7b service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:26.116663 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 646/1320] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:28.793944 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b17db0-1e74-4d2e-a58d-641345feb9dc None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:28.794512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b17db0-1e74-4d2e-a58d-641345feb9dc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:28.794512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b17db0-1e74-4d2e-a58d-641345feb9dc None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:28.795931 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 675/1321] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:28.801396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b5c5e-346c-463f-89b6-0cd25231427c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:28.801849 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b5c5e-346c-463f-89b6-0cd25231427c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:28.801929 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b5c5e-346c-463f-89b6-0cd25231427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:28.869136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4d2b5c5e-346c-463f-89b6-0cd25231427c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:28.870269 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4d2b5c5e-346c-463f-89b6-0cd25231427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:28.931847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:28.977824 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 647/1322] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:29.014709 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b17db0-1e74-4d2e-a58d-641345feb9dc None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:29.016309 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a9b17db0-1e74-4d2e-a58d-641345feb9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:29.038355 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:29.132777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b17db0-1e74-4d2e-a58d-641345feb9dc None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:29.212187 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7c305-3216-4862-aa47-941f70deaffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:29.212852 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7c305-3216-4862-aa47-941f70deaffb service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:29.213136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7c305-3216-4862-aa47-941f70deaffb service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:29.213437 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7c305-3216-4862-aa47-941f70deaffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:29.215147 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-64e7c305-3216-4862-aa47-941f70deaffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:29.292802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:29.336113 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7c305-3216-4862-aa47-941f70deaffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:29.337516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7c305-3216-4862-aa47-941f70deaffb service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:29.355980 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 676/1323] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:31.437711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb7048-6335-48bd-9bfc-e060fd11c11a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:31.438280 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb7048-6335-48bd-9bfc-e060fd11c11a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:31.438280 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb7048-6335-48bd-9bfc-e060fd11c11a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:31.439751 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 648/1324] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:31.445158 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9407a-e0e8-4edb-9d32-d36be213f1a9 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:31.445638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9407a-e0e8-4edb-9d32-d36be213f1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:31.445753 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9407a-e0e8-4edb-9d32-d36be213f1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:31.516970 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-7cc9407a-e0e8-4edb-9d32-d36be213f1a9 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:31.518243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-7cc9407a-e0e8-4edb-9d32-d36be213f1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:31.619887 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 677/1325] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:31.668545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9854a14-591e-441c-b12b-e497249f8016 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:31.668922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9854a14-591e-441c-b12b-e497249f8016 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:31.669300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9854a14-591e-441c-b12b-e497249f8016 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:31.670740 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 649/1326] 10.222.0.43 () {54 vars in 965 bytes} [Sun Jul 24 00:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:31.676839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbd488-b4d9-40a1-8918-f0a39cf76e56 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:31.677135 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbd488-b4d9-40a1-8918-f0a39cf76e56 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:31.677445 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbd488-b4d9-40a1-8918-f0a39cf76e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:31.709875 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:31.760140 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fdbbd488-b4d9-40a1-8918-f0a39cf76e56 None None] MFA Rules not processed for user `e0dae91953bf4a84883723bf3639e377`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:31.761451 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fdbbd488-b4d9-40a1-8918-f0a39cf76e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:31.844103 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 678/1327] 10.222.0.43 () {58 vars in 1062 bytes} [Sun Jul 24 00:57:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:31.853407 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9854a14-591e-441c-b12b-e497249f8016 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:31.855068 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d9854a14-591e-441c-b12b-e497249f8016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:31.981493 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9854a14-591e-441c-b12b-e497249f8016 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:32.070612 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d83d8b-bc89-47dc-8e3b-76f9100fa260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:32.071281 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d83d8b-bc89-47dc-8e3b-76f9100fa260 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:32.071570 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d83d8b-bc89-47dc-8e3b-76f9100fa260 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:32.071844 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d83d8b-bc89-47dc-8e3b-76f9100fa260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:32.073563 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-28d83d8b-bc89-47dc-8e3b-76f9100fa260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:32.092964 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:32.219118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d83d8b-bc89-47dc-8e3b-76f9100fa260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:32.220632 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d83d8b-bc89-47dc-8e3b-76f9100fa260 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:32.239816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 650/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:34.552130 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02694e-3f5c-47e7-a4a8-836579b4d849 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:34.552659 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02694e-3f5c-47e7-a4a8-836579b4d849 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:34.552767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02694e-3f5c-47e7-a4a8-836579b4d849 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:34.554281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 679/1329] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:34.559978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034538a-7f25-4b68-9df3-bcf6d681bbae None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:34.560415 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034538a-7f25-4b68-9df3-bcf6d681bbae None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:34.560533 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034538a-7f25-4b68-9df3-bcf6d681bbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:34.630894 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2034538a-7f25-4b68-9df3-bcf6d681bbae None None] MFA Rules not processed for user `21b09299f25d4591a38f3b193aad3d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:34.632107 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2034538a-7f25-4b68-9df3-bcf6d681bbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:34.719677 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:34.752913 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 651/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:34.790710 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02694e-3f5c-47e7-a4a8-836579b4d849 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:34.792266 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fb02694e-3f5c-47e7-a4a8-836579b4d849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:34.898637 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02694e-3f5c-47e7-a4a8-836579b4d849 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:34.923982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:34.984382 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7002ce1-e950-4061-bd64-e824992b8d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:34.985044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002ce1-e950-4061-bd64-e824992b8d9f service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:34.985357 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002ce1-e950-4061-bd64-e824992b8d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:34.985641 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002ce1-e950-4061-bd64-e824992b8d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:34.987320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c7002ce1-e950-4061-bd64-e824992b8d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:35.100051 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7002ce1-e950-4061-bd64-e824992b8d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:35.101516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7002ce1-e950-4061-bd64-e824992b8d9f service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:35.120129 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 680/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:37.556746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e63a9-72e2-441d-8508-a888dd1023ed None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.557451 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e63a9-72e2-441d-8508-a888dd1023ed None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.557451 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e63a9-72e2-441d-8508-a888dd1023ed None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.559055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 652/1332] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:37.564843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfd4ff-623c-45a8-ba67-6ea51f8606c1 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.565328 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfd4ff-623c-45a8-ba67-6ea51f8606c1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.565426 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfd4ff-623c-45a8-ba67-6ea51f8606c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.631824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:37.634709 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-48dfd4ff-623c-45a8-ba67-6ea51f8606c1 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:37.636388 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-48dfd4ff-623c-45a8-ba67-6ea51f8606c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:37.736120 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 681/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:57:37.776378 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e63a9-72e2-441d-8508-a888dd1023ed None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:37.778940 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-468e63a9-72e2-441d-8508-a888dd1023ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:37.896793 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e63a9-72e2-441d-8508-a888dd1023ed None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:37.980275 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b86fa-382d-484f-8605-5d501c500186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:37.980930 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b86fa-382d-484f-8605-5d501c500186 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.981229 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b86fa-382d-484f-8605-5d501c500186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.981502 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b86fa-382d-484f-8605-5d501c500186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.983183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-080b86fa-382d-484f-8605-5d501c500186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:38.012531 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:38.098156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b86fa-382d-484f-8605-5d501c500186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:38.099616 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b86fa-382d-484f-8605-5d501c500186 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:38.117317 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 653/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:40.177813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd6583-b1d7-45f4-94fc-f792bc0a069f None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:40.178845 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd6583-b1d7-45f4-94fc-f792bc0a069f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:40.178845 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd6583-b1d7-45f4-94fc-f792bc0a069f None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:40.180798 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 682/1335] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:40.189049 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c6035-fdf9-449f-bf61-02ed6c978045 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:40.189550 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c6035-fdf9-449f-bf61-02ed6c978045 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:40.189652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c6035-fdf9-449f-bf61-02ed6c978045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:40.258232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0b5c6035-fdf9-449f-bf61-02ed6c978045 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:40.259561 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0b5c6035-fdf9-449f-bf61-02ed6c978045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:40.351222 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:40.374123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 654/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:57:40.416176 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd6583-b1d7-45f4-94fc-f792bc0a069f None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:40.417765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-88fd6583-b1d7-45f4-94fc-f792bc0a069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:40.540126 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd6583-b1d7-45f4-94fc-f792bc0a069f None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:40.572957 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:40.629892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecefbb9-1445-4655-8405-f59243321807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:40.630554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecefbb9-1445-4655-8405-f59243321807 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:40.630836 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecefbb9-1445-4655-8405-f59243321807 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:40.631115 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecefbb9-1445-4655-8405-f59243321807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:40.632881 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-eecefbb9-1445-4655-8405-f59243321807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:40.751513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecefbb9-1445-4655-8405-f59243321807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:40.752944 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecefbb9-1445-4655-8405-f59243321807 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:40.771098 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 683/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:43.125296 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff9fda-d3b0-445b-948b-8e31fa77d274 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:43.125882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff9fda-d3b0-445b-948b-8e31fa77d274 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:43.125882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff9fda-d3b0-445b-948b-8e31fa77d274 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:43.127222 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 655/1338] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:43.132573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c0f1c-a86b-4d61-94c0-cfabe4d55a27 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:43.132953 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c0f1c-a86b-4d61-94c0-cfabe4d55a27 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:43.133131 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c0f1c-a86b-4d61-94c0-cfabe4d55a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:43.204846 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-157c0f1c-a86b-4d61-94c0-cfabe4d55a27 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:43.206108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-157c0f1c-a86b-4d61-94c0-cfabe4d55a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:43.215594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:43.314893 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 684/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:43.354192 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff9fda-d3b0-445b-948b-8e31fa77d274 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:43.358542 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b1ff9fda-d3b0-445b-948b-8e31fa77d274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:43.479224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff9fda-d3b0-445b-948b-8e31fa77d274 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:43.564256 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f12392-b7b8-4e44-9fda-a8d6f491042c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:43.564917 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f12392-b7b8-4e44-9fda-a8d6f491042c service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:43.565235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f12392-b7b8-4e44-9fda-a8d6f491042c service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:43.565504 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f12392-b7b8-4e44-9fda-a8d6f491042c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:43.567187 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-20f12392-b7b8-4e44-9fda-a8d6f491042c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:43.616069 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:43.694268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f12392-b7b8-4e44-9fda-a8d6f491042c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:43.695705 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f12392-b7b8-4e44-9fda-a8d6f491042c service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:43.716490 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 656/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:47.908962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ac531-8c73-405d-94c0-bf3e67f5ebcf None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.909555 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ac531-8c73-405d-94c0-bf3e67f5ebcf None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.909555 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ac531-8c73-405d-94c0-bf3e67f5ebcf None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.910912 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 685/1341] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:47.916247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676fe2-34bc-466a-b223-699825f2280b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.916686 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676fe2-34bc-466a-b223-699825f2280b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.916788 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676fe2-34bc-466a-b223-699825f2280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.982748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-89676fe2-34bc-466a-b223-699825f2280b None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:47.983946 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-89676fe2-34bc-466a-b223-699825f2280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:48.068936 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:48.081446 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 657/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:48.120540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ac531-8c73-405d-94c0-bf3e67f5ebcf None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:48.122154 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c23ac531-8c73-405d-94c0-bf3e67f5ebcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:48.230700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ac531-8c73-405d-94c0-bf3e67f5ebcf None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:48.270073 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:48.310820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ead7b-c132-4107-9533-763fb51edd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:48.311559 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ead7b-c132-4107-9533-763fb51edd76 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.311870 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ead7b-c132-4107-9533-763fb51edd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.312143 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ead7b-c132-4107-9533-763fb51edd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.313880 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4b2ead7b-c132-4107-9533-763fb51edd76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:48.428796 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ead7b-c132-4107-9533-763fb51edd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:48.430267 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ead7b-c132-4107-9533-763fb51edd76 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:48.448731 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 686/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:51.091505 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede6bf-e050-41d2-9765-c614760e7353 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:51.092110 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede6bf-e050-41d2-9765-c614760e7353 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:51.092219 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede6bf-e050-41d2-9765-c614760e7353 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:51.094332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 658/1344] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:51.102340 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efac89-3762-4129-a675-3cecab2e1abe None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:51.102814 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efac89-3762-4129-a675-3cecab2e1abe None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:51.102892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efac89-3762-4129-a675-3cecab2e1abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:51.176214 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d7efac89-3762-4129-a675-3cecab2e1abe None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:51.177461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d7efac89-3762-4129-a675-3cecab2e1abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:51.195210 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:51.274279 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 687/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:51.315174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdede6bf-e050-41d2-9765-c614760e7353 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:51.316885 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cdede6bf-e050-41d2-9765-c614760e7353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:51.431931 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdede6bf-e050-41d2-9765-c614760e7353 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:51.507185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8f0e1-4f15-405c-aca1-d897d0efc2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:51.507841 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8f0e1-4f15-405c-aca1-d897d0efc2cb service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:51.508096 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8f0e1-4f15-405c-aca1-d897d0efc2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:51.508392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8f0e1-4f15-405c-aca1-d897d0efc2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:51.510061 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-89b8f0e1-4f15-405c-aca1-d897d0efc2cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:51.553967 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:51.622820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8f0e1-4f15-405c-aca1-d897d0efc2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:51.624296 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8f0e1-4f15-405c-aca1-d897d0efc2cb service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:51.642620 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 659/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:55.620984 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66f88-022d-47ea-bcbe-43aa977f3a10 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:55.621631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66f88-022d-47ea-bcbe-43aa977f3a10 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:55.621631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66f88-022d-47ea-bcbe-43aa977f3a10 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:55.622981 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 688/1347] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:55.628395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62570a-55e1-4b5a-97a4-702b4109a807 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:55.628847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62570a-55e1-4b5a-97a4-702b4109a807 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:55.628972 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62570a-55e1-4b5a-97a4-702b4109a807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:55.698272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fa62570a-55e1-4b5a-97a4-702b4109a807 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:55.699657 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fa62570a-55e1-4b5a-97a4-702b4109a807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:55.808649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:55.811839 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 660/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:55.850216 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66f88-022d-47ea-bcbe-43aa977f3a10 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:55.851783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-77c66f88-022d-47ea-bcbe-43aa977f3a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:55.971433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66f88-022d-47ea-bcbe-43aa977f3a10 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:56.023994 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:56.055195 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37bb6a-d50f-4bf8-9ac4-27cad35fc10a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:56.056065 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37bb6a-d50f-4bf8-9ac4-27cad35fc10a service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:56.056357 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37bb6a-d50f-4bf8-9ac4-27cad35fc10a service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:56.056704 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37bb6a-d50f-4bf8-9ac4-27cad35fc10a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:56.058541 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-dc37bb6a-d50f-4bf8-9ac4-27cad35fc10a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:56.184048 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37bb6a-d50f-4bf8-9ac4-27cad35fc10a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:56.185558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37bb6a-d50f-4bf8-9ac4-27cad35fc10a service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:56.206428 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 689/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:01.139990 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e9d43-b00c-4c56-a1c5-fbb429f966c8 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.140497 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e9d43-b00c-4c56-a1c5-fbb429f966c8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.140604 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e9d43-b00c-4c56-a1c5-fbb429f966c8 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:01.142527 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 661/1350] 10.222.0.43 () {54 vars in 921 bytes} [Sun Jul 24 00:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:01.147757 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f4b23-883b-45b6-9d9f-20293d5de59d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.148183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f4b23-883b-45b6-9d9f-20293d5de59d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.148360 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f4b23-883b-45b6-9d9f-20293d5de59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:01.242163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-f19f4b23-883b-45b6-9d9f-20293d5de59d None None] MFA Rules not processed for user `cce671a84420484580cfd8efe6a6e227`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:01.245882 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-f19f4b23-883b-45b6-9d9f-20293d5de59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:01.267156 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:01.362767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 690/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Jul 24 00:58:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:05.374517 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be84ef-2973-4685-9472-7203b4816189 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:05.375585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be84ef-2973-4685-9472-7203b4816189 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:05.376056 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be84ef-2973-4685-9472-7203b4816189 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:05.377979 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 662/1352] 10.222.0.43 () {54 vars in 921 bytes} [Sun Jul 24 00:58:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:05.383194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44266abe-6f02-4bea-8270-4dc7f6dbbf75 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:05.383663 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44266abe-6f02-4bea-8270-4dc7f6dbbf75 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:05.383883 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44266abe-6f02-4bea-8270-4dc7f6dbbf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:05.460602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-44266abe-6f02-4bea-8270-4dc7f6dbbf75 None None] MFA Rules not processed for user `cce671a84420484580cfd8efe6a6e227`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:05.462029 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-44266abe-6f02-4bea-8270-4dc7f6dbbf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:05.538552 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:05.583205 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 691/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Jul 24 00:58:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:58:07.002212 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0d2a4-ba09-4ade-a1d3-1702616e7522 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.002766 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0d2a4-ba09-4ade-a1d3-1702616e7522 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.002766 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0d2a4-ba09-4ade-a1d3-1702616e7522 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.004116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 663/1354] 10.222.0.43 () {54 vars in 921 bytes} [Sun Jul 24 00:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:07.009717 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cde60-87c6-4dd9-b31c-2e5f263a8189 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.010145 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cde60-87c6-4dd9-b31c-2e5f263a8189 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.010437 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cde60-87c6-4dd9-b31c-2e5f263a8189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.088913 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-922cde60-87c6-4dd9-b31c-2e5f263a8189 None None] MFA Rules not processed for user `cce671a84420484580cfd8efe6a6e227`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:07.090164 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-922cde60-87c6-4dd9-b31c-2e5f263a8189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:07.206942 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 692/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Jul 24 00:58:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:10.555966 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e34de-0600-4bfd-87a6-7b5ac1c4440d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:10.556527 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e34de-0600-4bfd-87a6-7b5ac1c4440d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:10.556689 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e34de-0600-4bfd-87a6-7b5ac1c4440d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:10.558523 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 664/1356] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:10.564015 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7b893-275e-4ebe-b7c4-9ea6f1ef26cc None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:10.564493 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7b893-275e-4ebe-b7c4-9ea6f1ef26cc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:10.564606 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7b893-275e-4ebe-b7c4-9ea6f1ef26cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:10.608410 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:10.641707 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-3cf7b893-275e-4ebe-b7c4-9ea6f1ef26cc None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:10.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3cf7b893-275e-4ebe-b7c4-9ea6f1ef26cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:10.744048 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 693/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:10.797538 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622fe22-e33e-47fb-a0b5-4f79f8ae0be0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:10.798074 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622fe22-e33e-47fb-a0b5-4f79f8ae0be0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:10.798603 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622fe22-e33e-47fb-a0b5-4f79f8ae0be0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:10.800136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 665/1358] 10.222.0.43 () {54 vars in 962 bytes} [Sun Jul 24 00:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:10.807362 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156b46-2a9b-4d94-b83f-be62ca4de4e1 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:10.807911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156b46-2a9b-4d94-b83f-be62ca4de4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:10.808326 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156b46-2a9b-4d94-b83f-be62ca4de4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:10.889488 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-92156b46-2a9b-4d94-b83f-be62ca4de4e1 None None] MFA Rules not processed for user `808b08d1d2df42e587279071a5dba593`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:10.890898 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-92156b46-2a9b-4d94-b83f-be62ca4de4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:10.940367 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:11.012122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 694/1359] 10.222.0.43 () {58 vars in 1059 bytes} [Sun Jul 24 00:58:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:11.019995 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622fe22-e33e-47fb-a0b5-4f79f8ae0be0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:11.021669 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a622fe22-e33e-47fb-a0b5-4f79f8ae0be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:11.174430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622fe22-e33e-47fb-a0b5-4f79f8ae0be0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:11.248614 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:11.290723 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95e906-0e2f-4927-a99c-ac23869a437a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:11.291300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95e906-0e2f-4927-a99c-ac23869a437a service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:11.291580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95e906-0e2f-4927-a99c-ac23869a437a service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:11.291848 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95e906-0e2f-4927-a99c-ac23869a437a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:11.293520 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1d95e906-0e2f-4927-a99c-ac23869a437a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:11.387337 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95e906-0e2f-4927-a99c-ac23869a437a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:11.389031 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95e906-0e2f-4927-a99c-ac23869a437a service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:11.408613 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 666/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:13.640930 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5f802-719d-47ea-8ceb-560d32d707d3 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:13.641525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5f802-719d-47ea-8ceb-560d32d707d3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:13.641525 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5f802-719d-47ea-8ceb-560d32d707d3 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:13.643244 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 695/1361] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:13.649152 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b727ee-f8af-465b-9ad8-13c24a612512 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:13.650167 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b727ee-f8af-465b-9ad8-13c24a612512 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:13.650652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b727ee-f8af-465b-9ad8-13c24a612512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:13.718906 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-85b727ee-f8af-465b-9ad8-13c24a612512 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:13.720052 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-85b727ee-f8af-465b-9ad8-13c24a612512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:13.764501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:13.833496 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 667/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:13.877021 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5f802-719d-47ea-8ceb-560d32d707d3 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:13.878839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bff5f802-719d-47ea-8ceb-560d32d707d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:14.053719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5f802-719d-47ea-8ceb-560d32d707d3 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:14.064601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:14.194327 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66eb060-5b2d-403f-a664-139034fe8a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:14.195081 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb060-5b2d-403f-a664-139034fe8a1e service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:14.195432 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb060-5b2d-403f-a664-139034fe8a1e service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:14.195775 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb060-5b2d-403f-a664-139034fe8a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:14.197799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b66eb060-5b2d-403f-a664-139034fe8a1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:14.294631 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66eb060-5b2d-403f-a664-139034fe8a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:14.296281 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66eb060-5b2d-403f-a664-139034fe8a1e service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:14.316771 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 696/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:16.690850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df9a18-7b12-4ee8-b51b-2fdb32462da4 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:16.691411 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df9a18-7b12-4ee8-b51b-2fdb32462da4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:16.691411 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df9a18-7b12-4ee8-b51b-2fdb32462da4 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:16.692788 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 668/1364] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:16.698197 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75107ee-4bf2-4b27-8d0f-4d401db55c54 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:16.698615 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75107ee-4bf2-4b27-8d0f-4d401db55c54 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:16.698799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75107ee-4bf2-4b27-8d0f-4d401db55c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:16.714352 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:16.775296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d75107ee-4bf2-4b27-8d0f-4d401db55c54 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:16.776616 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d75107ee-4bf2-4b27-8d0f-4d401db55c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:16.899985 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 697/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:58:16.940168 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fef9f-b1a3-42e7-947e-724dcac7d057 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:16.940628 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fef9f-b1a3-42e7-947e-724dcac7d057 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:16.941062 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fef9f-b1a3-42e7-947e-724dcac7d057 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:16.942584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 669/1366] 10.222.0.43 () {54 vars in 962 bytes} [Sun Jul 24 00:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:16.948558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5da30-b740-4315-b601-4d8b2e116c16 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:16.948933 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5da30-b740-4315-b601-4d8b2e116c16 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:16.949297 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5da30-b740-4315-b601-4d8b2e116c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.035996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-12d5da30-b740-4315-b601-4d8b2e116c16 None None] MFA Rules not processed for user `808b08d1d2df42e587279071a5dba593`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:17.037789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-12d5da30-b740-4315-b601-4d8b2e116c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:17.078241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:17.174331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 698/1367] 10.222.0.43 () {58 vars in 1059 bytes} [Sun Jul 24 00:58:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:17.182226 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fef9f-b1a3-42e7-947e-724dcac7d057 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:17.183791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2d4fef9f-b1a3-42e7-947e-724dcac7d057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:17.347493 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fef9f-b1a3-42e7-947e-724dcac7d057 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:17.368239 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:17.466344 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a71e5c-e436-4b7f-adee-0925e930439c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:17.466913 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a71e5c-e436-4b7f-adee-0925e930439c service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.467195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a71e5c-e436-4b7f-adee-0925e930439c service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.467456 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a71e5c-e436-4b7f-adee-0925e930439c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.469112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-87a71e5c-e436-4b7f-adee-0925e930439c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:17.561755 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a71e5c-e436-4b7f-adee-0925e930439c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:17.563369 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a71e5c-e436-4b7f-adee-0925e930439c service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:17.596209 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 670/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:18.520839 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce06c5-f060-4b1a-bc84-1d93d98826ca None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:18.521486 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce06c5-f060-4b1a-bc84-1d93d98826ca None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:18.521486 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce06c5-f060-4b1a-bc84-1d93d98826ca None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:18.523102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 699/1369] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:18.528169 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610787a-a735-400a-84b7-5f1054a324bb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:18.528613 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610787a-a735-400a-84b7-5f1054a324bb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:18.528709 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610787a-a735-400a-84b7-5f1054a324bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:18.559018 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:18.594709 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d610787a-a735-400a-84b7-5f1054a324bb None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:18.595930 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d610787a-a735-400a-84b7-5f1054a324bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:18.713268 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 671/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:19.052067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ba708-585c-4cda-b5e5-644f305901ae None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:19.052363 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ba708-585c-4cda-b5e5-644f305901ae None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:19.052644 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ba708-585c-4cda-b5e5-644f305901ae None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:19.055105 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 700/1371] 10.222.0.43 () {54 vars in 964 bytes} [Sun Jul 24 00:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:19.059120 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b7168-0502-44e8-88b9-e8f2d3988d69 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:19.059436 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b7168-0502-44e8-88b9-e8f2d3988d69 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:19.059715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b7168-0502-44e8-88b9-e8f2d3988d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:19.142638 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9f2b7168-0502-44e8-88b9-e8f2d3988d69 None None] MFA Rules not processed for user `6c87c6bb14d74884a8c4ff8915d2494e`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:19.143873 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9f2b7168-0502-44e8-88b9-e8f2d3988d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:19.194484 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:19.233588 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 672/1372] 10.222.0.43 () {58 vars in 1061 bytes} [Sun Jul 24 00:58:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:19.234975 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ba708-585c-4cda-b5e5-644f305901ae None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:19.236664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ff3ba708-585c-4cda-b5e5-644f305901ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:19.347348 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ba708-585c-4cda-b5e5-644f305901ae None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:19.389027 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:19.424813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3137283-396f-48b5-9eda-27d15920a2bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c87c6bb14d74884a8c4ff8915d2494e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:19.427150 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137283-396f-48b5-9eda-27d15920a2bb service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:19.427150 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137283-396f-48b5-9eda-27d15920a2bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:19.427150 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137283-396f-48b5-9eda-27d15920a2bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:19.427977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d3137283-396f-48b5-9eda-27d15920a2bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:19.548472 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3137283-396f-48b5-9eda-27d15920a2bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:19.550061 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3137283-396f-48b5-9eda-27d15920a2bb service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:19.570422 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 701/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:19.714546 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ed4e3-cc6c-4f6d-95c2-3b366697a508 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:19.715047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ed4e3-cc6c-4f6d-95c2-3b366697a508 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:19.715047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ed4e3-cc6c-4f6d-95c2-3b366697a508 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:19.717528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 673/1374] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:19.721513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296eea7-9eee-4479-8a0e-2a597f6f499d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:19.721789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296eea7-9eee-4479-8a0e-2a597f6f499d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:19.722090 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296eea7-9eee-4479-8a0e-2a597f6f499d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:19.786584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-6296eea7-9eee-4479-8a0e-2a597f6f499d None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:19.787818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6296eea7-9eee-4479-8a0e-2a597f6f499d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:19.808427 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:19.883408 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 702/1375] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:19.931078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ed4e3-cc6c-4f6d-95c2-3b366697a508 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:19.932682 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a63ed4e3-cc6c-4f6d-95c2-3b366697a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:20.083470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ed4e3-cc6c-4f6d-95c2-3b366697a508 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:20.141508 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:20.202849 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16bb19-fb29-41a8-a1dd-39c8d02974f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:20.203497 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16bb19-fb29-41a8-a1dd-39c8d02974f9 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:20.203786 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16bb19-fb29-41a8-a1dd-39c8d02974f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:20.204057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16bb19-fb29-41a8-a1dd-39c8d02974f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:20.206122 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ac16bb19-fb29-41a8-a1dd-39c8d02974f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:20.296792 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16bb19-fb29-41a8-a1dd-39c8d02974f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:20.298405 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16bb19-fb29-41a8-a1dd-39c8d02974f9 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:20.317115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 674/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:22.365162 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baf5dc-d7de-4dd8-92d1-0bcca79ede52 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.365808 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baf5dc-d7de-4dd8-92d1-0bcca79ede52 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.365808 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baf5dc-d7de-4dd8-92d1-0bcca79ede52 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.367187 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 703/1377] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:22.372642 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ede8c-c6ac-4595-8ed8-5d6a5d214751 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.373058 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ede8c-c6ac-4595-8ed8-5d6a5d214751 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.373192 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ede8c-c6ac-4595-8ed8-5d6a5d214751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.446367 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-691ede8c-c6ac-4595-8ed8-5d6a5d214751 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:22.447625 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-691ede8c-c6ac-4595-8ed8-5d6a5d214751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:22.454880 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:22.585467 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 675/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:22.629925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9baf5dc-d7de-4dd8-92d1-0bcca79ede52 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:22.631532 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a9baf5dc-d7de-4dd8-92d1-0bcca79ede52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:22.789243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9baf5dc-d7de-4dd8-92d1-0bcca79ede52 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:22.792930 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:22.920866 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65a162-b307-4950-a32e-6693ce2bf187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:22.921559 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a162-b307-4950-a32e-6693ce2bf187 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.921844 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a162-b307-4950-a32e-6693ce2bf187 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.922119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a162-b307-4950-a32e-6693ce2bf187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.923750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8f65a162-b307-4950-a32e-6693ce2bf187 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:23.044945 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65a162-b307-4950-a32e-6693ce2bf187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:23.047609 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65a162-b307-4950-a32e-6693ce2bf187 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:23.068972 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 704/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:25.132405 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf6612-899b-49ec-88f4-47363e47f630 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.132926 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf6612-899b-49ec-88f4-47363e47f630 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.133160 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf6612-899b-49ec-88f4-47363e47f630 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.134811 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 676/1380] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:25.140371 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916139-5d3d-4010-9787-8860607e2a67 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.140849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916139-5d3d-4010-9787-8860607e2a67 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.140944 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916139-5d3d-4010-9787-8860607e2a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.151898 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:25.212037 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-29916139-5d3d-4010-9787-8860607e2a67 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:25.213347 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-29916139-5d3d-4010-9787-8860607e2a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:25.315565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 705/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:25.357495 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf6612-899b-49ec-88f4-47363e47f630 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:25.359052 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5faf6612-899b-49ec-88f4-47363e47f630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:25.503273 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:25.516230 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf6612-899b-49ec-88f4-47363e47f630 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:25.649190 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28708da-42a3-4cda-a814-b856cbf335ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:25.650217 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28708da-42a3-4cda-a814-b856cbf335ec service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.650500 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28708da-42a3-4cda-a814-b856cbf335ec service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.650772 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28708da-42a3-4cda-a814-b856cbf335ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.652636 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e28708da-42a3-4cda-a814-b856cbf335ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:25.750363 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28708da-42a3-4cda-a814-b856cbf335ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:25.752311 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28708da-42a3-4cda-a814-b856cbf335ec service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:25.764223 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:25.778056 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 677/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:27.856503 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80ca76-9648-42c8-8786-d88f0a722253 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:27.857064 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80ca76-9648-42c8-8786-d88f0a722253 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:27.857399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80ca76-9648-42c8-8786-d88f0a722253 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:27.859668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 706/1383] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:27.865113 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e07804-394c-47a1-9776-119c1501efad None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:27.865602 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e07804-394c-47a1-9776-119c1501efad None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:27.865699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e07804-394c-47a1-9776-119c1501efad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:27.932157 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-05e07804-394c-47a1-9776-119c1501efad None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:27.933418 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-05e07804-394c-47a1-9776-119c1501efad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:28.052776 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 678/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:28.097851 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80ca76-9648-42c8-8786-d88f0a722253 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:28.100456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5a80ca76-9648-42c8-8786-d88f0a722253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:28.201777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:28.274014 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80ca76-9648-42c8-8786-d88f0a722253 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:28.415131 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cabc75-0baf-43a2-8cb1-11574c99ba52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:28.415829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cabc75-0baf-43a2-8cb1-11574c99ba52 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:28.416108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cabc75-0baf-43a2-8cb1-11574c99ba52 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:28.416374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cabc75-0baf-43a2-8cb1-11574c99ba52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:28.418114 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-39cabc75-0baf-43a2-8cb1-11574c99ba52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:28.469742 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:28.525881 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cabc75-0baf-43a2-8cb1-11574c99ba52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:28.528645 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cabc75-0baf-43a2-8cb1-11574c99ba52 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:28.554471 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 707/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:31.464835 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6012b-6709-450e-bb92-81393bd73acd None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.465456 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6012b-6709-450e-bb92-81393bd73acd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.465736 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6012b-6709-450e-bb92-81393bd73acd None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.467845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 679/1386] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:31.475548 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f4503-e93f-40df-9b0f-7809a52f8476 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.476004 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f4503-e93f-40df-9b0f-7809a52f8476 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.476321 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f4503-e93f-40df-9b0f-7809a52f8476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.568547 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-bf4f4503-e93f-40df-9b0f-7809a52f8476 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:31.569969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bf4f4503-e93f-40df-9b0f-7809a52f8476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:31.698328 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 708/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:31.761403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6012b-6709-450e-bb92-81393bd73acd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:31.763010 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4cb6012b-6709-450e-bb92-81393bd73acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:31.849374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:31.925074 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6012b-6709-450e-bb92-81393bd73acd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:32.053480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913654a-5fa9-409a-8abd-9f256294ac2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:32.054085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913654a-5fa9-409a-8abd-9f256294ac2e service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:32.054371 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913654a-5fa9-409a-8abd-9f256294ac2e service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:32.054652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913654a-5fa9-409a-8abd-9f256294ac2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:32.056483 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6913654a-5fa9-409a-8abd-9f256294ac2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:32.097323 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:32.149699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913654a-5fa9-409a-8abd-9f256294ac2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:32.151390 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913654a-5fa9-409a-8abd-9f256294ac2e service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:32.169708 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 680/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 00:58:34.222776 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdbd82-e348-4f3d-a179-94ec051a7814 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:34.223332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdbd82-e348-4f3d-a179-94ec051a7814 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:34.223332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdbd82-e348-4f3d-a179-94ec051a7814 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:34.224628 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 709/1389] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:34.230217 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866ced-ac46-4639-af24-049130998425 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:34.230672 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866ced-ac46-4639-af24-049130998425 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:34.230774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866ced-ac46-4639-af24-049130998425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:34.296919 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-03866ced-ac46-4639-af24-049130998425 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:34.298144 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-03866ced-ac46-4639-af24-049130998425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:34.396809 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 681/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:34.441346 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdbd82-e348-4f3d-a179-94ec051a7814 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:34.442886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d0fdbd82-e348-4f3d-a179-94ec051a7814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:34.475189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:34.518463 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae5803-9870-42d4-9089-4252715f6456 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:34.518758 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae5803-9870-42d4-9089-4252715f6456 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:34.519040 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae5803-9870-42d4-9089-4252715f6456 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:34.520444 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 682/1391] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:58:34.525489 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d7a29-7ec9-42f6-8709-587b585f2915 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:34.525781 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d7a29-7ec9-42f6-8709-587b585f2915 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:34.526059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d7a29-7ec9-42f6-8709-587b585f2915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:34.540288 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:34.594342 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-734d7a29-7ec9-42f6-8709-587b585f2915 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:34.595072 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdbd82-e348-4f3d-a179-94ec051a7814 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:34.595567 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-734d7a29-7ec9-42f6-8709-587b585f2915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:34.693616 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 683/1392] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:58:34.697409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:34.709638 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c7a4f-4ecc-47b0-89a7-01c6bb6af025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:34.710298 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c7a4f-4ecc-47b0-89a7-01c6bb6af025 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:34.710583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c7a4f-4ecc-47b0-89a7-01c6bb6af025 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:34.711012 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c7a4f-4ecc-47b0-89a7-01c6bb6af025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:34.712662 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1d5c7a4f-4ecc-47b0-89a7-01c6bb6af025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:34.749464 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261d2d8-e55a-42fc-bd15-a11f9f63f3b3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:34.749759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261d2d8-e55a-42fc-bd15-a11f9f63f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:34.750034 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261d2d8-e55a-42fc-bd15-a11f9f63f3b3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:34.751425 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 684/1393] 10.222.0.43 () {54 vars in 966 bytes} [Sun Jul 24 00:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:58:34.756162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eac727-e9b4-4aca-b19a-7ef6c3304d4e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:34.756565 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eac727-e9b4-4aca-b19a-7ef6c3304d4e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:34.756841 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eac727-e9b4-4aca-b19a-7ef6c3304d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:34.815555 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c7a4f-4ecc-47b0-89a7-01c6bb6af025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:34.817259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c7a4f-4ecc-47b0-89a7-01c6bb6af025 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:34.837573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 710/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:34.848376 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-24eac727-e9b4-4aca-b19a-7ef6c3304d4e None None] MFA Rules not processed for user `3c366d0b41ee4632b6ba0c3bb11511f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:34.849859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-24eac727-e9b4-4aca-b19a-7ef6c3304d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:34.885881 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:34.930824 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 685/1395] 10.222.0.43 () {58 vars in 1063 bytes} [Sun Jul 24 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:58:34.938744 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c7a4f-4ecc-47b0-89a7-01c6bb6af025 service nova] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:34.940111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1d5c7a4f-4ecc-47b0-89a7-01c6bb6af025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:35.027590 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c7a4f-4ecc-47b0-89a7-01c6bb6af025 service nova] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:35.074305 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:35.109949 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f98d-83d3-47dc-9724-27258b820417 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c366d0b41ee4632b6ba0c3bb11511f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:35.110610 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f98d-83d3-47dc-9724-27258b820417 service glance] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:35.110894 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f98d-83d3-47dc-9724-27258b820417 service glance] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:35.111172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f98d-83d3-47dc-9724-27258b820417 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:35.112829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-93a2f98d-83d3-47dc-9724-27258b820417 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:35.226334 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2f98d-83d3-47dc-9724-27258b820417 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:35.227799 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2f98d-83d3-47dc-9724-27258b820417 service glance] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:35.246600 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 711/1396] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:35.959210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e83fe4-a741-4860-823f-0493a94e80d0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:35.959726 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e83fe4-a741-4860-823f-0493a94e80d0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:35.959832 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e83fe4-a741-4860-823f-0493a94e80d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.031584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-55e83fe4-a741-4860-823f-0493a94e80d0 None None] MFA Rules not processed for user `8a465bdbfe3248679adc15154a152d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:36.032796 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-55e83fe4-a741-4860-823f-0493a94e80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:36.122515 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 686/1397] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Jul 24 00:58:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:36.168245 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557fc43-4a48-4dea-9690-a8d8358badc4 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.168563 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557fc43-4a48-4dea-9690-a8d8358badc4 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.168843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557fc43-4a48-4dea-9690-a8d8358badc4 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.170338 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 712/1398] 10.222.0.43 () {54 vars in 943 bytes} [Sun Jul 24 00:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:36.176820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef528a0-ff2d-43f7-8189-722eb6008bd2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.177112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef528a0-ff2d-43f7-8189-722eb6008bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.177466 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef528a0-ff2d-43f7-8189-722eb6008bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.233969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:36.252124 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-bef528a0-ff2d-43f7-8189-722eb6008bd2 None None] MFA Rules not processed for user `bd9e9ad3ecec40b9a3c88a5f2b8fdfe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:36.253334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bef528a0-ff2d-43f7-8189-722eb6008bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:36.363823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 687/1399] 10.222.0.43 () {58 vars in 1040 bytes} [Sun Jul 24 00:58:36 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:36.374271 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557fc43-4a48-4dea-9690-a8d8358badc4 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:36.375863 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9557fc43-4a48-4dea-9690-a8d8358badc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:36.455918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:36.521073 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557fc43-4a48-4dea-9690-a8d8358badc4 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:36.628389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5debbca-804e-4489-9dcd-4b4e67d24056 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd9e9ad3ecec40b9a3c88a5f2b8fdfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:36.629044 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5debbca-804e-4489-9dcd-4b4e67d24056 service swift] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.629364 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5debbca-804e-4489-9dcd-4b4e67d24056 service swift] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.629657 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5debbca-804e-4489-9dcd-4b4e67d24056 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.631335 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b5debbca-804e-4489-9dcd-4b4e67d24056 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:36.690253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:36.716581 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5debbca-804e-4489-9dcd-4b4e67d24056 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:36.718216 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5debbca-804e-4489-9dcd-4b4e67d24056 service swift] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:36.726491 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 713/1400] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Jul 24 00:58:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 00:58:36.916528 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a08ce-08e1-4eee-a6da-9f647c8b1dd3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.916818 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a08ce-08e1-4eee-a6da-9f647c8b1dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.917112 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a08ce-08e1-4eee-a6da-9f647c8b1dd3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.918509 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 688/1401] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:36.923923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a888f-d43b-4f57-9c5f-794349818ae2 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.924222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a888f-d43b-4f57-9c5f-794349818ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.924511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a888f-d43b-4f57-9c5f-794349818ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.996706 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-956a888f-d43b-4f57-9c5f-794349818ae2 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:36.997978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-956a888f-d43b-4f57-9c5f-794349818ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:37.102304 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 714/1402] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:37.147515 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a08ce-08e1-4eee-a6da-9f647c8b1dd3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:37.149084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a98a08ce-08e1-4eee-a6da-9f647c8b1dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:37.258532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:37.303283 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a08ce-08e1-4eee-a6da-9f647c8b1dd3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:37.423966 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55dff3-ad06-400c-a234-a97793c04a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:37.424807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55dff3-ad06-400c-a234-a97793c04a4a service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:37.425167 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55dff3-ad06-400c-a234-a97793c04a4a service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:37.425602 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55dff3-ad06-400c-a234-a97793c04a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.427390 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8d55dff3-ad06-400c-a234-a97793c04a4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:37.507384 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:37.528027 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55dff3-ad06-400c-a234-a97793c04a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:37.529960 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55dff3-ad06-400c-a234-a97793c04a4a service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:37.550647 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 689/1403] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:39.634673 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbf0e3-84e3-46b6-b546-cb3df27950f5 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:39.635209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbf0e3-84e3-46b6-b546-cb3df27950f5 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:39.635209 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbf0e3-84e3-46b6-b546-cb3df27950f5 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:39.637546 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 715/1404] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:39.641945 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaa989-d25d-48c4-b9b2-e3e5e0819827 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:39.642380 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaa989-d25d-48c4-b9b2-e3e5e0819827 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:39.642792 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaa989-d25d-48c4-b9b2-e3e5e0819827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:39.714257 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5ecaa989-d25d-48c4-b9b2-e3e5e0819827 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:39.715488 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5ecaa989-d25d-48c4-b9b2-e3e5e0819827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:39.818216 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 690/1405] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:58:39.866399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbf0e3-84e3-46b6-b546-cb3df27950f5 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:39.867969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c6dbf0e3-84e3-46b6-b546-cb3df27950f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:40.014789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.157531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbf0e3-84e3-46b6-b546-cb3df27950f5 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:40.284830 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da895514-5b2c-409c-820d-1bbba6d4e915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:40.285553 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da895514-5b2c-409c-820d-1bbba6d4e915 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.285810 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da895514-5b2c-409c-820d-1bbba6d4e915 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.286091 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da895514-5b2c-409c-820d-1bbba6d4e915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.287782 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-da895514-5b2c-409c-820d-1bbba6d4e915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:40.303120 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.395777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da895514-5b2c-409c-820d-1bbba6d4e915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:40.397745 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da895514-5b2c-409c-820d-1bbba6d4e915 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:40.419145 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 716/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:42.481402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108155b2-83e0-44ff-ba82-30145d3a24c9 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.481973 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108155b2-83e0-44ff-ba82-30145d3a24c9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.481973 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108155b2-83e0-44ff-ba82-30145d3a24c9 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.483366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 691/1407] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 00:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:42.488641 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d86ce-d4a5-427c-85c4-32644e5431cc None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.489112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d86ce-d4a5-427c-85c4-32644e5431cc None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.489350 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d86ce-d4a5-427c-85c4-32644e5431cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.574586 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4b0d86ce-d4a5-427c-85c4-32644e5431cc None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:42.575829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4b0d86ce-d4a5-427c-85c4-32644e5431cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:42.678497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:42.691965 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 717/1408] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:42.738727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108155b2-83e0-44ff-ba82-30145d3a24c9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:42.740503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-108155b2-83e0-44ff-ba82-30145d3a24c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:42.796968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:42.899245 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108155b2-83e0-44ff-ba82-30145d3a24c9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:43.020956 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919d41b-4b9b-419e-8b97-1735a160c121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:43.021555 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919d41b-4b9b-419e-8b97-1735a160c121 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:43.022078 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919d41b-4b9b-419e-8b97-1735a160c121 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:43.022356 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919d41b-4b9b-419e-8b97-1735a160c121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:43.024056 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4919d41b-4b9b-419e-8b97-1735a160c121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:43.033218 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:43.129290 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919d41b-4b9b-419e-8b97-1735a160c121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:43.130969 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919d41b-4b9b-419e-8b97-1735a160c121 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:43.150346 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 692/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:52.690154 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=5 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:53.147559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=41 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:58.790265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe5556-2815-4f77-8d07-5ff70ac69fa2 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:58.790842 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe5556-2815-4f77-8d07-5ff70ac69fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:58.790842 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe5556-2815-4f77-8d07-5ff70ac69fa2 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:58.792292 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 718/1410] 10.222.0.43 () {54 vars in 918 bytes} [Sun Jul 24 00:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:58.797922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3166df4-9ca0-48f3-9f9f-9320a2da3bf6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:58.798486 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3166df4-9ca0-48f3-9f9f-9320a2da3bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:58.798486 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3166df4-9ca0-48f3-9f9f-9320a2da3bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:58.880127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b3166df4-9ca0-48f3-9f9f-9320a2da3bf6 None None] MFA Rules not processed for user `cce671a84420484580cfd8efe6a6e227`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:58.881307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b3166df4-9ca0-48f3-9f9f-9320a2da3bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:58.992624 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 693/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Sun Jul 24 00:58:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:58:59.007310 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110800c-8dfe-46f2-bb6b-84839bbb0c9e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.007592 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110800c-8dfe-46f2-bb6b-84839bbb0c9e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.007863 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110800c-8dfe-46f2-bb6b-84839bbb0c9e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.009278 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 719/1412] 10.222.0.43 () {54 vars in 918 bytes} [Sun Jul 24 00:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:59.014164 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4bef9-cc0d-4302-9d17-e2e230452a8f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.014487 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4bef9-cc0d-4302-9d17-e2e230452a8f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.014765 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4bef9-cc0d-4302-9d17-e2e230452a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.085676 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:59.089074 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8ef4bef9-cc0d-4302-9d17-e2e230452a8f None None] MFA Rules not processed for user `808b08d1d2df42e587279071a5dba593`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:59.091160 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8ef4bef9-cc0d-4302-9d17-e2e230452a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:59.218350 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 694/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Sun Jul 24 00:58:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:01.715230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0988a-28ed-42ee-a993-b3368ad2b3e2 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:01.715783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0988a-28ed-42ee-a993-b3368ad2b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:01.715783 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0988a-28ed-42ee-a993-b3368ad2b3e2 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:01.717169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 720/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:01.723684 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27600b01-cf0b-4dd4-b94c-776e61911110 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:01.724410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27600b01-cf0b-4dd4-b94c-776e61911110 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:01.724569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27600b01-cf0b-4dd4-b94c-776e61911110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:01.799752 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-27600b01-cf0b-4dd4-b94c-776e61911110 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:01.801643 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-27600b01-cf0b-4dd4-b94c-776e61911110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:01.863145 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:01.906962 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 695/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:01.955656 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0988a-28ed-42ee-a993-b3368ad2b3e2 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:01.958232 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-abe0988a-28ed-42ee-a993-b3368ad2b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:02.108877 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0988a-28ed-42ee-a993-b3368ad2b3e2 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:02.183810 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:02.225890 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8d56d-4caf-4275-9389-2fde5514e0da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:02.226540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d56d-4caf-4275-9389-2fde5514e0da service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:02.226817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d56d-4caf-4275-9389-2fde5514e0da service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:02.227098 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d56d-4caf-4275-9389-2fde5514e0da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:02.228772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-54f8d56d-4caf-4275-9389-2fde5514e0da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:02.331428 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8d56d-4caf-4275-9389-2fde5514e0da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:02.333061 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8d56d-4caf-4275-9389-2fde5514e0da service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:02.351528 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 721/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:03.275671 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037a779-8bb1-45ad-9b86-b8ec55d56a06 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.276265 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037a779-8bb1-45ad-9b86-b8ec55d56a06 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.276265 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037a779-8bb1-45ad-9b86-b8ec55d56a06 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.277662 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:03.283645 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540dd85-3d28-4460-a700-d31c3825e5b6 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.284067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540dd85-3d28-4460-a700-d31c3825e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.284215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540dd85-3d28-4460-a700-d31c3825e5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.378453 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4540dd85-3d28-4460-a700-d31c3825e5b6 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:03.379677 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4540dd85-3d28-4460-a700-d31c3825e5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:03.411302 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:03.488265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:03.636544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037a779-8bb1-45ad-9b86-b8ec55d56a06 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:03.638101 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0037a779-8bb1-45ad-9b86-b8ec55d56a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:03.794314 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037a779-8bb1-45ad-9b86-b8ec55d56a06 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:03.837002 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:03.913674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1969baf-92ec-4a0c-afc3-a01a70a2148a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:03.914323 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1969baf-92ec-4a0c-afc3-a01a70a2148a service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.914596 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1969baf-92ec-4a0c-afc3-a01a70a2148a service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.914863 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1969baf-92ec-4a0c-afc3-a01a70a2148a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.916593 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e1969baf-92ec-4a0c-afc3-a01a70a2148a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:04.007059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1969baf-92ec-4a0c-afc3-a01a70a2148a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:04.008694 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1969baf-92ec-4a0c-afc3-a01a70a2148a service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:04.028197 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 697/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:04.919888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a04d-e0ad-45cd-87e5-0fc5802ef8ff None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:04.920448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a04d-e0ad-45cd-87e5-0fc5802ef8ff None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:04.920448 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a04d-e0ad-45cd-87e5-0fc5802ef8ff None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:04.921899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:04.926990 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad7c7a-150e-498e-a8e7-9acb8a77224d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:04.927451 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad7c7a-150e-498e-a8e7-9acb8a77224d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:04.927548 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad7c7a-150e-498e-a8e7-9acb8a77224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:04.992861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:05.015505 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e4ad7c7a-150e-498e-a8e7-9acb8a77224d None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:05.016750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e4ad7c7a-150e-498e-a8e7-9acb8a77224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:05.123401 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:05.289122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04a04d-e0ad-45cd-87e5-0fc5802ef8ff None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:05.291447 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ed04a04d-e0ad-45cd-87e5-0fc5802ef8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:05.454669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04a04d-e0ad-45cd-87e5-0fc5802ef8ff None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:05.468087 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:05.577995 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76975e8-09ab-4e65-a449-2a07a5c1f79b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:05.578761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76975e8-09ab-4e65-a449-2a07a5c1f79b service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.579088 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76975e8-09ab-4e65-a449-2a07a5c1f79b service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.579807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76975e8-09ab-4e65-a449-2a07a5c1f79b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.582036 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b76975e8-09ab-4e65-a449-2a07a5c1f79b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:05.687920 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76975e8-09ab-4e65-a449-2a07a5c1f79b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:05.689564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76975e8-09ab-4e65-a449-2a07a5c1f79b service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:05.709223 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 724/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:06.595283 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1d51d-fa30-4dfe-90a3-2ae68201dd82 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.595806 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1d51d-fa30-4dfe-90a3-2ae68201dd82 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.595806 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1d51d-fa30-4dfe-90a3-2ae68201dd82 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.597859 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:06.605191 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0df9d-740c-4379-8c29-adacc4615dcd None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.605708 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0df9d-740c-4379-8c29-adacc4615dcd None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.605807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0df9d-740c-4379-8c29-adacc4615dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.624479 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:06.685251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-16a0df9d-740c-4379-8c29-adacc4615dcd None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:06.686487 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-16a0df9d-740c-4379-8c29-adacc4615dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:06.798948 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:06.951249 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1d51d-fa30-4dfe-90a3-2ae68201dd82 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.952852 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fcd1d51d-fa30-4dfe-90a3-2ae68201dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:07.066183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:07.102916 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1d51d-fa30-4dfe-90a3-2ae68201dd82 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:07.223578 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc2bb0-c728-4a7b-999c-93da13967a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:07.224158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc2bb0-c728-4a7b-999c-93da13967a78 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:07.224465 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc2bb0-c728-4a7b-999c-93da13967a78 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:07.224737 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc2bb0-c728-4a7b-999c-93da13967a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:07.226458 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2dcc2bb0-c728-4a7b-999c-93da13967a78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:07.316778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:07.333183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc2bb0-c728-4a7b-999c-93da13967a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:07.334850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc2bb0-c728-4a7b-999c-93da13967a78 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:07.353302 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 700/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:08.217948 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f2429-489a-46e3-82b9-7eb738473524 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:08.218580 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f2429-489a-46e3-82b9-7eb738473524 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:08.218580 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f2429-489a-46e3-82b9-7eb738473524 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:08.219901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:08.226215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9172f7-e19b-4310-8c29-8790311a98c4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:08.226937 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9172f7-e19b-4310-8c29-8790311a98c4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:08.227097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9172f7-e19b-4310-8c29-8790311a98c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:08.306856 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3c9172f7-e19b-4310-8c29-8790311a98c4 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:08.308055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3c9172f7-e19b-4310-8c29-8790311a98c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:08.410203 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:08.561035 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f2429-489a-46e3-82b9-7eb738473524 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:08.563238 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-876f2429-489a-46e3-82b9-7eb738473524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:08.672532 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:08.738808 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f2429-489a-46e3-82b9-7eb738473524 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:08.855993 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b7f6f-77c4-456d-b898-9457ad18bcac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:08.856574 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b7f6f-77c4-456d-b898-9457ad18bcac service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:08.856857 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b7f6f-77c4-456d-b898-9457ad18bcac service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:08.857133 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b7f6f-77c4-456d-b898-9457ad18bcac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:08.858827 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-330b7f6f-77c4-456d-b898-9457ad18bcac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:08.907668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:08.953095 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b7f6f-77c4-456d-b898-9457ad18bcac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:08.954773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b7f6f-77c4-456d-b898-9457ad18bcac service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:08.974585 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 727/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:09.784547 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529f666-c0df-40bf-b08f-2939c0e43710 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:09.785508 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529f666-c0df-40bf-b08f-2939c0e43710 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:09.785508 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529f666-c0df-40bf-b08f-2939c0e43710 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:09.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:09.793108 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba0b49-9694-48ea-85fb-3cd2c4565390 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:09.793665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba0b49-9694-48ea-85fb-3cd2c4565390 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:09.793665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba0b49-9694-48ea-85fb-3cd2c4565390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:09.874292 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-eeba0b49-9694-48ea-85fb-3cd2c4565390 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:09.875424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-eeba0b49-9694-48ea-85fb-3cd2c4565390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:09.994473 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:10.143725 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529f666-c0df-40bf-b08f-2939c0e43710 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:10.145174 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5529f666-c0df-40bf-b08f-2939c0e43710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:10.207553 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:10.317486 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529f666-c0df-40bf-b08f-2939c0e43710 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:10.436773 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9840210-3399-465f-bbb8-cb03d8724cfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:10.437471 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9840210-3399-465f-bbb8-cb03d8724cfc service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.437756 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9840210-3399-465f-bbb8-cb03d8724cfc service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.438032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9840210-3399-465f-bbb8-cb03d8724cfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.439713 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e9840210-3399-465f-bbb8-cb03d8724cfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:10.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:10.547563 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9840210-3399-465f-bbb8-cb03d8724cfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:10.549217 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9840210-3399-465f-bbb8-cb03d8724cfc service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:10.567765 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 703/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:11.363912 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44abfd0-e5bc-4fbb-91b0-49d14d0b7649 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.364531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44abfd0-e5bc-4fbb-91b0-49d14d0b7649 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.364531 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44abfd0-e5bc-4fbb-91b0-49d14d0b7649 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.365924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:11.372076 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e09952-5c9d-4f22-a95e-ba50d7a57b3c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.372812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e09952-5c9d-4f22-a95e-ba50d7a57b3c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.372957 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e09952-5c9d-4f22-a95e-ba50d7a57b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.452094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-89e09952-5c9d-4f22-a95e-ba50d7a57b3c None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:11.453325 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-89e09952-5c9d-4f22-a95e-ba50d7a57b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:11.525813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:11.555095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:11.708067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44abfd0-e5bc-4fbb-91b0-49d14d0b7649 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:11.710733 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b44abfd0-e5bc-4fbb-91b0-49d14d0b7649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:11.731802 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:11.887988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44abfd0-e5bc-4fbb-91b0-49d14d0b7649 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:11.992762 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:12.020641 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9242f2-eb17-484d-858f-2c3c7de278ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.021508 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9242f2-eb17-484d-858f-2c3c7de278ae service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.021797 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9242f2-eb17-484d-858f-2c3c7de278ae service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.022077 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9242f2-eb17-484d-858f-2c3c7de278ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.023734 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0c9242f2-eb17-484d-858f-2c3c7de278ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:12.116227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9242f2-eb17-484d-858f-2c3c7de278ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.117884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9242f2-eb17-484d-858f-2c3c7de278ae service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.137221 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 730/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:12.968025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc84836-dfd1-4de3-be61-7b6cc8af68a3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.968926 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc84836-dfd1-4de3-be61-7b6cc8af68a3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.968926 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc84836-dfd1-4de3-be61-7b6cc8af68a3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.971104 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:12.979438 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac472f-00d9-47a2-9104-dac094689624 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.979866 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac472f-00d9-47a2-9104-dac094689624 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.980037 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac472f-00d9-47a2-9104-dac094689624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.061372 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a8ac472f-00d9-47a2-9104-dac094689624 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:13.062601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a8ac472f-00d9-47a2-9104-dac094689624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:13.105595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:13.166024 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:13.330932 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc84836-dfd1-4de3-be61-7b6cc8af68a3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:13.332764 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fcc84836-dfd1-4de3-be61-7b6cc8af68a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:13.488856 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc84836-dfd1-4de3-be61-7b6cc8af68a3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:13.546551 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:13.608195 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d3272-8724-44a0-ae2c-076e665d7890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:13.608851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d3272-8724-44a0-ae2c-076e665d7890 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.609131 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d3272-8724-44a0-ae2c-076e665d7890 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.609433 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d3272-8724-44a0-ae2c-076e665d7890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.611105 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6f3d3272-8724-44a0-ae2c-076e665d7890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:13.701249 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d3272-8724-44a0-ae2c-076e665d7890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:13.702893 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d3272-8724-44a0-ae2c-076e665d7890 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:13.721423 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 706/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:14.524719 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1885ddb-b9bd-430e-bc3e-f4b04a4359c2 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:14.525766 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1885ddb-b9bd-430e-bc3e-f4b04a4359c2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:14.525766 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1885ddb-b9bd-430e-bc3e-f4b04a4359c2 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:14.527183 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:14.533232 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aefe13-4565-49f7-a663-7971fcdbad36 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:14.533956 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aefe13-4565-49f7-a663-7971fcdbad36 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:14.534054 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aefe13-4565-49f7-a663-7971fcdbad36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:14.622963 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-61aefe13-4565-49f7-a663-7971fcdbad36 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:14.624185 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-61aefe13-4565-49f7-a663-7971fcdbad36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:14.626292 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:14.735999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:14.888265 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1885ddb-b9bd-430e-bc3e-f4b04a4359c2 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:14.889831 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b1885ddb-b9bd-430e-bc3e-f4b04a4359c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:15.052243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1885ddb-b9bd-430e-bc3e-f4b04a4359c2 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:15.081126 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:15.183697 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb418de0-fd57-4c84-8799-e1579e845b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:15.184358 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418de0-fd57-4c84-8799-e1579e845b27 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.184643 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418de0-fd57-4c84-8799-e1579e845b27 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.184919 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418de0-fd57-4c84-8799-e1579e845b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.186618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bb418de0-fd57-4c84-8799-e1579e845b27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:15.281046 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb418de0-fd57-4c84-8799-e1579e845b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:15.283045 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb418de0-fd57-4c84-8799-e1579e845b27 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:15.310361 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 733/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:17.252161 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7853-533e-4f2e-a0a1-d77d1a570e0b None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:17.252755 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7853-533e-4f2e-a0a1-d77d1a570e0b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:17.252755 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7853-533e-4f2e-a0a1-d77d1a570e0b None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:17.254124 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:17.260546 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890034b-e296-4f3c-9f6a-5f6374c26966 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:17.260979 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890034b-e296-4f3c-9f6a-5f6374c26966 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:17.261074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890034b-e296-4f3c-9f6a-5f6374c26966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:17.303051 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:17.332328 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2890034b-e296-4f3c-9f6a-5f6374c26966 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:17.333591 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2890034b-e296-4f3c-9f6a-5f6374c26966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:17.436823 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:17.476306 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7853-533e-4f2e-a0a1-d77d1a570e0b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:17.478773 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6bbe7853-533e-4f2e-a0a1-d77d1a570e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:17.595885 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7853-533e-4f2e-a0a1-d77d1a570e0b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:17.631981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:17.681779 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e6600-d20f-4512-a5b4-489f3051be54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:17.682477 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e6600-d20f-4512-a5b4-489f3051be54 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:17.682791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e6600-d20f-4512-a5b4-489f3051be54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:17.683070 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e6600-d20f-4512-a5b4-489f3051be54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:17.684794 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-314e6600-d20f-4512-a5b4-489f3051be54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:17.800164 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e6600-d20f-4512-a5b4-489f3051be54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:17.802482 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e6600-d20f-4512-a5b4-489f3051be54 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:17.823299 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 709/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:19.989941 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039175d-9fe1-4365-99f9-6272d57fe85d None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.990384 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039175d-9fe1-4365-99f9-6272d57fe85d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.990496 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039175d-9fe1-4365-99f9-6272d57fe85d None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.991931 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:19.998597 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358a1ec-a719-40c5-b706-832fe645b72f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.999055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358a1ec-a719-40c5-b706-832fe645b72f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.999162 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358a1ec-a719-40c5-b706-832fe645b72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:20.076375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4358a1ec-a719-40c5-b706-832fe645b72f None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:20.078287 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4358a1ec-a719-40c5-b706-832fe645b72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:20.099434 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:20.196643 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:20.239241 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039175d-9fe1-4365-99f9-6272d57fe85d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:20.241620 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8039175d-9fe1-4365-99f9-6272d57fe85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:20.357472 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039175d-9fe1-4365-99f9-6272d57fe85d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:20.369775 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:20.442005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c62b6-3a57-4d51-9271-a050096e0fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:20.442671 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c62b6-3a57-4d51-9271-a050096e0fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:20.442956 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c62b6-3a57-4d51-9271-a050096e0fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:20.443229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c62b6-3a57-4d51-9271-a050096e0fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:20.444905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-bd4c62b6-3a57-4d51-9271-a050096e0fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:20.564636 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c62b6-3a57-4d51-9271-a050096e0fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:20.566040 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c62b6-3a57-4d51-9271-a050096e0fa8 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:20.586168 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 736/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:22.936658 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75363651-3e46-4fe2-8e80-9a4683a07a07 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.937575 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75363651-3e46-4fe2-8e80-9a4683a07a07 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.937575 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75363651-3e46-4fe2-8e80-9a4683a07a07 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.939796 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:22.946471 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2808d-2658-4a50-b0d2-eaa1ac6007fd None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.947252 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2808d-2658-4a50-b0d2-eaa1ac6007fd None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.947409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2808d-2658-4a50-b0d2-eaa1ac6007fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:23.001562 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:23.019332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-9fc2808d-2658-4a50-b0d2-eaa1ac6007fd None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:23.020544 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9fc2808d-2658-4a50-b0d2-eaa1ac6007fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:23.122657 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:23.161335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75363651-3e46-4fe2-8e80-9a4683a07a07 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:23.162871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-75363651-3e46-4fe2-8e80-9a4683a07a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:23.270986 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75363651-3e46-4fe2-8e80-9a4683a07a07 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:23.313171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:23.352694 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68c531-64dc-45b5-9161-930ce7358382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:23.353386 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68c531-64dc-45b5-9161-930ce7358382 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:23.353803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68c531-64dc-45b5-9161-930ce7358382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:23.354085 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68c531-64dc-45b5-9161-930ce7358382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:23.355749 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ad68c531-64dc-45b5-9161-930ce7358382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:23.479819 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68c531-64dc-45b5-9161-930ce7358382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:23.481307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68c531-64dc-45b5-9161-930ce7358382 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:23.500416 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 712/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:25.658117 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f9cab-ced8-4461-b74c-7b7823991020 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:25.659091 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f9cab-ced8-4461-b74c-7b7823991020 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:25.659091 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f9cab-ced8-4461-b74c-7b7823991020 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:25.661262 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:25.669652 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ec89d-f3ee-46ba-977b-4d802322ae76 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:25.670090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ec89d-f3ee-46ba-977b-4d802322ae76 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:25.670227 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ec89d-f3ee-46ba-977b-4d802322ae76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:25.748218 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f34ec89d-f3ee-46ba-977b-4d802322ae76 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:25.749473 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f34ec89d-f3ee-46ba-977b-4d802322ae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:25.771184 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:25.855699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:25.897905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f9cab-ced8-4461-b74c-7b7823991020 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:25.900011 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-072f9cab-ced8-4461-b74c-7b7823991020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:26.009709 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f9cab-ced8-4461-b74c-7b7823991020 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:26.030375 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:26.087628 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5844c-c610-4d6c-8640-4fdd33d5694e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:26.088284 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5844c-c610-4d6c-8640-4fdd33d5694e service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:26.088566 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5844c-c610-4d6c-8640-4fdd33d5694e service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:26.088843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5844c-c610-4d6c-8640-4fdd33d5694e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:26.090539 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e8a5844c-c610-4d6c-8640-4fdd33d5694e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:26.209421 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5844c-c610-4d6c-8640-4fdd33d5694e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:26.210892 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5844c-c610-4d6c-8640-4fdd33d5694e service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:26.231425 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 739/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:28.456933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5b637-2d2f-4b2a-a59e-e0479caac15d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.457558 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5b637-2d2f-4b2a-a59e-e0479caac15d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.457558 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5b637-2d2f-4b2a-a59e-e0479caac15d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.458892 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:28.467053 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6e7c4-e038-4acd-b2e0-628379dd7560 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.467538 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6e7c4-e038-4acd-b2e0-628379dd7560 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.467636 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6e7c4-e038-4acd-b2e0-628379dd7560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.563389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:28.568324 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-18f6e7c4-e038-4acd-b2e0-628379dd7560 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:28.571259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-18f6e7c4-e038-4acd-b2e0-628379dd7560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:28.681907 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:28.724403 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5b637-2d2f-4b2a-a59e-e0479caac15d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:28.726872 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7fb5b637-2d2f-4b2a-a59e-e0479caac15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:28.848574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5b637-2d2f-4b2a-a59e-e0479caac15d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:28.906532 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:28.932090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60ca9-ce80-4a34-a974-2223c89706cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:28.932753 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60ca9-ce80-4a34-a974-2223c89706cc service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.933033 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60ca9-ce80-4a34-a974-2223c89706cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.933334 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60ca9-ce80-4a34-a974-2223c89706cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.934989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1fd60ca9-ce80-4a34-a974-2223c89706cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:29.054253 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd60ca9-ce80-4a34-a974-2223c89706cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:29.055628 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd60ca9-ce80-4a34-a974-2223c89706cc service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:29.073947 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 715/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:31.180313 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71a57c-3436-40ad-840a-93f9330b9f25 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.180864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71a57c-3436-40ad-840a-93f9330b9f25 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.180987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71a57c-3436-40ad-840a-93f9330b9f25 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.182541 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:31.189126 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec3a3-dfd6-44b3-91e9-aad3c7295b1e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.189561 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec3a3-dfd6-44b3-91e9-aad3c7295b1e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.189789 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec3a3-dfd6-44b3-91e9-aad3c7295b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.278247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-422ec3a3-dfd6-44b3-91e9-aad3c7295b1e None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:31.279529 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-422ec3a3-dfd6-44b3-91e9-aad3c7295b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:31.312270 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:31.385131 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:31.425786 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71a57c-3436-40ad-840a-93f9330b9f25 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:31.427335 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4c71a57c-3436-40ad-840a-93f9330b9f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:31.531165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71a57c-3436-40ad-840a-93f9330b9f25 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:31.561760 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:31.610852 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862795bd-7b26-465f-8edc-377bce5a2bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:31.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862795bd-7b26-465f-8edc-377bce5a2bda service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.611803 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862795bd-7b26-465f-8edc-377bce5a2bda service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.612080 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862795bd-7b26-465f-8edc-377bce5a2bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.613776 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-862795bd-7b26-465f-8edc-377bce5a2bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:31.729234 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862795bd-7b26-465f-8edc-377bce5a2bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:31.730700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862795bd-7b26-465f-8edc-377bce5a2bda service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:31.749653 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 742/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 00:59:33.828998 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c05f-b9fc-4b54-838e-c5083888d058 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:33.829627 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c05f-b9fc-4b54-838e-c5083888d058 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:33.829627 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c05f-b9fc-4b54-838e-c5083888d058 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:33.830984 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:33.837119 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a81348-541e-4e26-9386-1cd8cb01f2ad None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:33.837613 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a81348-541e-4e26-9386-1cd8cb01f2ad None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:33.837613 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a81348-541e-4e26-9386-1cd8cb01f2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:33.910596 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-98a81348-541e-4e26-9386-1cd8cb01f2ad None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:33.911795 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-98a81348-541e-4e26-9386-1cd8cb01f2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:33.920537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:34.041102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:59:34.094159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77c05f-b9fc-4b54-838e-c5083888d058 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:34.095763 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1a77c05f-b9fc-4b54-838e-c5083888d058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:34.212105 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77c05f-b9fc-4b54-838e-c5083888d058 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:34.269666 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:34.289355 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47b8a5-2330-4179-af29-4c276643e45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:34.290007 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b8a5-2330-4179-af29-4c276643e45f service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:34.290259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b8a5-2330-4179-af29-4c276643e45f service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:34.290560 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b8a5-2330-4179-af29-4c276643e45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:34.292214 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ba47b8a5-2330-4179-af29-4c276643e45f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:34.410489 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47b8a5-2330-4179-af29-4c276643e45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:34.411941 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47b8a5-2330-4179-af29-4c276643e45f service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:34.430684 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 718/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:36.531100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa956b-41a7-4001-b580-6352dc624347 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:36.531789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa956b-41a7-4001-b580-6352dc624347 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:36.531789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa956b-41a7-4001-b580-6352dc624347 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:36.533057 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:36.538592 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117da06f-c2b9-46f0-822f-802f21673628 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:36.539079 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117da06f-c2b9-46f0-822f-802f21673628 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:36.539183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117da06f-c2b9-46f0-822f-802f21673628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:36.634372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-117da06f-c2b9-46f0-822f-802f21673628 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:36.635737 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-117da06f-c2b9-46f0-822f-802f21673628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:36.675148 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:36.742402 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:36.780274 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa956b-41a7-4001-b580-6352dc624347 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:36.781954 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9afa956b-41a7-4001-b580-6352dc624347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:36.893933 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa956b-41a7-4001-b580-6352dc624347 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:36.934744 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:36.972399 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907b19e-bfc3-4810-8971-f84793cc2193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:36.973055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907b19e-bfc3-4810-8971-f84793cc2193 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:36.973366 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907b19e-bfc3-4810-8971-f84793cc2193 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:36.973640 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907b19e-bfc3-4810-8971-f84793cc2193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:36.975309 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b907b19e-bfc3-4810-8971-f84793cc2193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:37.089586 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907b19e-bfc3-4810-8971-f84793cc2193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:37.090973 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907b19e-bfc3-4810-8971-f84793cc2193 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:37.109904 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 745/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:39.145035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35a006-d5cf-42e0-ad1c-f6cfb9bc16ae None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.145694 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35a006-d5cf-42e0-ad1c-f6cfb9bc16ae None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.145694 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35a006-d5cf-42e0-ad1c-f6cfb9bc16ae None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.147012 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:39.153688 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24cae-d899-4c2f-a78a-9ec411ab6741 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.154424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24cae-d899-4c2f-a78a-9ec411ab6741 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.154589 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24cae-d899-4c2f-a78a-9ec411ab6741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.222930 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2bc24cae-d899-4c2f-a78a-9ec411ab6741 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:39.224139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2bc24cae-d899-4c2f-a78a-9ec411ab6741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:39.242971 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:39.326340 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:39.368346 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35a006-d5cf-42e0-ad1c-f6cfb9bc16ae None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:39.370079 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8d35a006-d5cf-42e0-ad1c-f6cfb9bc16ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:39.481583 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35a006-d5cf-42e0-ad1c-f6cfb9bc16ae None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:39.559668 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:39.567469 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d679b2-a14f-4799-b32a-6aef7573457b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:39.568129 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d679b2-a14f-4799-b32a-6aef7573457b service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.568412 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d679b2-a14f-4799-b32a-6aef7573457b service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.568667 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d679b2-a14f-4799-b32a-6aef7573457b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.570376 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a9d679b2-a14f-4799-b32a-6aef7573457b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:39.684778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d679b2-a14f-4799-b32a-6aef7573457b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:39.686267 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d679b2-a14f-4799-b32a-6aef7573457b service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:39.705632 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 721/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:41.747263 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf869c2-b997-4b7d-bd66-678f6586a324 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:41.747852 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf869c2-b997-4b7d-bd66-678f6586a324 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:41.747852 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf869c2-b997-4b7d-bd66-678f6586a324 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:41.749219 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:41.755723 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4800545-6b87-4af1-a0f5-c5f775dc8b1e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:41.756462 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4800545-6b87-4af1-a0f5-c5f775dc8b1e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:41.756641 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4800545-6b87-4af1-a0f5-c5f775dc8b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:41.833526 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f4800545-6b87-4af1-a0f5-c5f775dc8b1e None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:41.834857 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f4800545-6b87-4af1-a0f5-c5f775dc8b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:41.887123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:41.938013 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:41.975414 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf869c2-b997-4b7d-bd66-678f6586a324 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:41.976958 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ecf869c2-b997-4b7d-bd66-678f6586a324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:42.099986 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf869c2-b997-4b7d-bd66-678f6586a324 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:42.276481 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:42.307130 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b49dc-0f65-43f8-bb00-4780be69fd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:42.307795 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b49dc-0f65-43f8-bb00-4780be69fd65 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.308074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b49dc-0f65-43f8-bb00-4780be69fd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.308342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b49dc-0f65-43f8-bb00-4780be69fd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.310030 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9b8b49dc-0f65-43f8-bb00-4780be69fd65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:42.422896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b49dc-0f65-43f8-bb00-4780be69fd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:42.424338 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b49dc-0f65-43f8-bb00-4780be69fd65 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:42.443779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 748/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:51.936148 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=22 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:52.441097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=66 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:02.071379 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204196eb-af9b-4a7e-9985-3c7951d2284e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:02.072224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204196eb-af9b-4a7e-9985-3c7951d2284e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:02.072393 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204196eb-af9b-4a7e-9985-3c7951d2284e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:02.074644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 723/1471] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 01:00:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:02.081099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbff03-1045-4aba-8c7e-b62067f35ce7 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:02.081576 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbff03-1045-4aba-8c7e-b62067f35ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:02.081745 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbff03-1045-4aba-8c7e-b62067f35ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:02.150351 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-30fbff03-1045-4aba-8c7e-b62067f35ce7 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:02.151560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-30fbff03-1045-4aba-8c7e-b62067f35ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:02.252856 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 749/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:02.352049 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23dfab-a192-4b9e-b87f-f5c575d192ea None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:02.352410 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23dfab-a192-4b9e-b87f-f5c575d192ea None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:02.352779 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23dfab-a192-4b9e-b87f-f5c575d192ea None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:02.354724 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 724/1473] 10.222.0.43 () {54 vars in 966 bytes} [Sun Jul 24 01:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:02.359694 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d663c04-1b9b-4b1e-b681-cee62a77e332 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:02.359983 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d663c04-1b9b-4b1e-b681-cee62a77e332 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:02.360258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d663c04-1b9b-4b1e-b681-cee62a77e332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:02.437355 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2d663c04-1b9b-4b1e-b681-cee62a77e332 None None] MFA Rules not processed for user `3c366d0b41ee4632b6ba0c3bb11511f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:02.438564 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2d663c04-1b9b-4b1e-b681-cee62a77e332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:02.460770 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:02.518779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 750/1474] 10.222.0.43 () {58 vars in 1063 bytes} [Sun Jul 24 01:00:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:02.530116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23dfab-a192-4b9e-b87f-f5c575d192ea None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:02.532420 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ad23dfab-a192-4b9e-b87f-f5c575d192ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:02.654729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23dfab-a192-4b9e-b87f-f5c575d192ea None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:02.755850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17fee4-e975-4e13-a1d3-42b4a707ce87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c366d0b41ee4632b6ba0c3bb11511f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:02.756847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17fee4-e975-4e13-a1d3-42b4a707ce87 service glance] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:02.757139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17fee4-e975-4e13-a1d3-42b4a707ce87 service glance] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:02.757450 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17fee4-e975-4e13-a1d3-42b4a707ce87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:02.759136 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-aa17fee4-e975-4e13-a1d3-42b4a707ce87 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:02.820014 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:02.877676 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17fee4-e975-4e13-a1d3-42b4a707ce87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:02.879132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17fee4-e975-4e13-a1d3-42b4a707ce87 service glance] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:02.898927 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 725/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:05.000769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6175a-8b7e-496e-af7d-4f8f9ca6f280 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:05.001407 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6175a-8b7e-496e-af7d-4f8f9ca6f280 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:05.001407 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6175a-8b7e-496e-af7d-4f8f9ca6f280 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:05.002748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 751/1476] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 01:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:05.009264 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fad0f-2447-43c2-b104-6ae4202575fe None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:05.010024 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fad0f-2447-43c2-b104-6ae4202575fe None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:05.010173 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fad0f-2447-43c2-b104-6ae4202575fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:05.079470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-610fad0f-2447-43c2-b104-6ae4202575fe None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:05.080673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-610fad0f-2447-43c2-b104-6ae4202575fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:05.181497 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 726/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:05.204853 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6175a-8b7e-496e-af7d-4f8f9ca6f280 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:05.206426 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-96d6175a-8b7e-496e-af7d-4f8f9ca6f280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:05.337722 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6175a-8b7e-496e-af7d-4f8f9ca6f280 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:05.391029 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:05.438107 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabfbb2-64a7-4f06-beae-69c6df0ed070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:05.438768 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabfbb2-64a7-4f06-beae-69c6df0ed070 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:05.439045 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabfbb2-64a7-4f06-beae-69c6df0ed070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:05.439320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabfbb2-64a7-4f06-beae-69c6df0ed070 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:05.440039 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabfbb2-64a7-4f06-beae-69c6df0ed070 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:05.441807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-feabfbb2-64a7-4f06-beae-69c6df0ed070 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:00:05.441807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Jul 24 01:00:05.441807 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: Jul 24 01:00:05.442938 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabfbb2-64a7-4f06-beae-69c6df0ed070 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:05.462097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 752/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Jul 24 01:00:05 2022] GET /identity/v3/projects => generated 2553 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:00:07.533512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0ffc4-f306-45eb-8227-ce0c8e4da495 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:07.534569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0ffc4-f306-45eb-8227-ce0c8e4da495 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:07.534569 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0ffc4-f306-45eb-8227-ce0c8e4da495 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:07.536645 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 727/1479] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 01:00:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:07.543102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f6963-1943-43c1-aaaf-a418f59261ab None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:07.543602 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f6963-1943-43c1-aaaf-a418f59261ab None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:07.543710 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f6963-1943-43c1-aaaf-a418f59261ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:07.618478 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-683f6963-1943-43c1-aaaf-a418f59261ab None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:07.619806 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-683f6963-1943-43c1-aaaf-a418f59261ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:07.736561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 753/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:07.779756 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0ffc4-f306-45eb-8227-ce0c8e4da495 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:07.781355 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-edf0ffc4-f306-45eb-8227-ce0c8e4da495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:07.791640 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:07.933598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0ffc4-f306-45eb-8227-ce0c8e4da495 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:08.024861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:08.057765 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9048f9-9cd6-4c45-8ba0-e71d79795664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:08.058360 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9048f9-9cd6-4c45-8ba0-e71d79795664 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:08.058639 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9048f9-9cd6-4c45-8ba0-e71d79795664 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:08.058909 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9048f9-9cd6-4c45-8ba0-e71d79795664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:08.060717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2c9048f9-9cd6-4c45-8ba0-e71d79795664 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:08.157552 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9048f9-9cd6-4c45-8ba0-e71d79795664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:08.159155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9048f9-9cd6-4c45-8ba0-e71d79795664 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:08.177614 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 728/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:10.353270 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ad32f-a9a4-48ee-8d0b-fb821da5a051 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:10.353853 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ad32f-a9a4-48ee-8d0b-fb821da5a051 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:10.353853 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ad32f-a9a4-48ee-8d0b-fb821da5a051 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:10.355459 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 754/1482] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 01:00:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:10.361970 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01793b-d227-4bfe-9cca-3fb627311bd3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:10.362739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01793b-d227-4bfe-9cca-3fb627311bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:10.362894 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01793b-d227-4bfe-9cca-3fb627311bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:10.432822 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5b01793b-d227-4bfe-9cca-3fb627311bd3 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:10.434084 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5b01793b-d227-4bfe-9cca-3fb627311bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:10.483030 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:10.548743 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 729/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:10.585425 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ad32f-a9a4-48ee-8d0b-fb821da5a051 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:10.586988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-3d9ad32f-a9a4-48ee-8d0b-fb821da5a051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:10.611223 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:10.699923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ad32f-a9a4-48ee-8d0b-fb821da5a051 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:10.778825 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d265c-4363-42be-8355-d769c68ff126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:10.779481 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d265c-4363-42be-8355-d769c68ff126 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:10.779924 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d265c-4363-42be-8355-d769c68ff126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:10.780203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d265c-4363-42be-8355-d769c68ff126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:10.781916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-e53d265c-4363-42be-8355-d769c68ff126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:10.860320 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:10.897070 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d265c-4363-42be-8355-d769c68ff126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:10.898468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d265c-4363-42be-8355-d769c68ff126 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:10.923314 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 755/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:12.980290 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22975c-b431-44da-9984-e8be0b48de1b None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:12.980813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22975c-b431-44da-9984-e8be0b48de1b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:12.980813 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22975c-b431-44da-9984-e8be0b48de1b None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:12.982307 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 730/1485] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 01:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:12.988777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d83e-c69a-48c8-bcdc-17b746f74ea3 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:12.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d83e-c69a-48c8-bcdc-17b746f74ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:12.990419 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d83e-c69a-48c8-bcdc-17b746f74ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:13.066540 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a897d83e-c69a-48c8-bcdc-17b746f74ea3 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:13.067779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a897d83e-c69a-48c8-bcdc-17b746f74ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:13.179561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 756/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:13.218321 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22975c-b431-44da-9984-e8be0b48de1b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:13.220194 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0d22975c-b431-44da-9984-e8be0b48de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:13.325985 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22975c-b431-44da-9984-e8be0b48de1b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:13.400023 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:13.402271 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a4461-9c2d-424d-b176-0c23d64c9720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:13.404030 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a4461-9c2d-424d-b176-0c23d64c9720 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:13.404030 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a4461-9c2d-424d-b176-0c23d64c9720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:13.404030 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a4461-9c2d-424d-b176-0c23d64c9720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:13.406116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0c4a4461-9c2d-424d-b176-0c23d64c9720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:13.520108 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a4461-9c2d-424d-b176-0c23d64c9720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:13.521539 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a4461-9c2d-424d-b176-0c23d64c9720 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:13.540491 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 731/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:15.697136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8587cc-7eb7-4d5f-b651-4a59eaa7816d None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:15.697740 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8587cc-7eb7-4d5f-b651-4a59eaa7816d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:15.697740 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8587cc-7eb7-4d5f-b651-4a59eaa7816d None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:15.699032 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 757/1488] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 01:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:15.705447 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769014ca-e143-41e9-a0ad-4c500d247275 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:15.706148 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769014ca-e143-41e9-a0ad-4c500d247275 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:15.706253 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769014ca-e143-41e9-a0ad-4c500d247275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:15.788333 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-769014ca-e143-41e9-a0ad-4c500d247275 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:15.789593 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-769014ca-e143-41e9-a0ad-4c500d247275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:15.844407 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:15.892644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 732/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:15.936627 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8587cc-7eb7-4d5f-b651-4a59eaa7816d None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:15.939136 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-6f8587cc-7eb7-4d5f-b651-4a59eaa7816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:15.987310 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:16.057244 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8587cc-7eb7-4d5f-b651-4a59eaa7816d None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:16.140511 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc2474-fca9-486e-96ae-ef8f53ecca4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:16.141170 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc2474-fca9-486e-96ae-ef8f53ecca4e service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:16.141484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc2474-fca9-486e-96ae-ef8f53ecca4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:16.141761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc2474-fca9-486e-96ae-ef8f53ecca4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:16.143427 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2acc2474-fca9-486e-96ae-ef8f53ecca4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:16.233745 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:16.265404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc2474-fca9-486e-96ae-ef8f53ecca4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:16.266796 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc2474-fca9-486e-96ae-ef8f53ecca4e service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:16.287100 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 758/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:18.548190 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9660982-2a95-4895-a086-56bc12f2c798 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:18.548788 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9660982-2a95-4895-a086-56bc12f2c798 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:18.548788 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9660982-2a95-4895-a086-56bc12f2c798 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:18.550155 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 733/1491] 10.222.0.43 () {54 vars in 926 bytes} [Sun Jul 24 01:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:18.556594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa76164-6504-4a37-b386-d57e43b29410 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:18.557036 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa76164-6504-4a37-b386-d57e43b29410 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:18.557169 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa76164-6504-4a37-b386-d57e43b29410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:18.626715 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0aa76164-6504-4a37-b386-d57e43b29410 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:18.627977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0aa76164-6504-4a37-b386-d57e43b29410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:18.742339 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 759/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:18.782172 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9660982-2a95-4895-a086-56bc12f2c798 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:18.784616 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b9660982-2a95-4895-a086-56bc12f2c798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:18.903672 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9660982-2a95-4895-a086-56bc12f2c798 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:18.980500 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde6a6f-0b51-4d13-9e1a-b14d4586426e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:18.981236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde6a6f-0b51-4d13-9e1a-b14d4586426e service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:18.981525 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde6a6f-0b51-4d13-9e1a-b14d4586426e service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:18.981800 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde6a6f-0b51-4d13-9e1a-b14d4586426e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:18.983470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2dde6a6f-0b51-4d13-9e1a-b14d4586426e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:18.993083 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:19.115117 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde6a6f-0b51-4d13-9e1a-b14d4586426e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:19.116593 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde6a6f-0b51-4d13-9e1a-b14d4586426e service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:19.135096 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 734/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:28.739054 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=82 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:29.132449 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=50 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:45.177431 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2581-5bde-4e21-8ed1-17d7769575da None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:45.178065 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2581-5bde-4e21-8ed1-17d7769575da None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:45.178065 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2581-5bde-4e21-8ed1-17d7769575da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:45.254309 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-aeea2581-5bde-4e21-8ed1-17d7769575da None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:45.255515 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-aeea2581-5bde-4e21-8ed1-17d7769575da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:45.364537 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 760/1494] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:01:45.373010 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26fed5-4229-4d13-b2ba-5b34e76f19a9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:45.373559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26fed5-4229-4d13-b2ba-5b34e76f19a9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:45.373559 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26fed5-4229-4d13-b2ba-5b34e76f19a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:45.455921 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-cf26fed5-4229-4d13-b2ba-5b34e76f19a9 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:45.457151 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cf26fed5-4229-4d13-b2ba-5b34e76f19a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:45.553545 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 735/1495] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:01:45.558565 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea2581-5bde-4e21-8ed1-17d7769575da None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:45.559922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-aeea2581-5bde-4e21-8ed1-17d7769575da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:45.572387 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea2581-5bde-4e21-8ed1-17d7769575da None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:45.643980 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:45.681534 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943072e-e740-4a52-a774-9caf9edb7209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:45.682441 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943072e-e740-4a52-a774-9caf9edb7209 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:45.682726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943072e-e740-4a52-a774-9caf9edb7209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:45.682999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943072e-e740-4a52-a774-9caf9edb7209 admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:45.683821 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943072e-e740-4a52-a774-9caf9edb7209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:45.684294 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943072e-e740-4a52-a774-9caf9edb7209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:45.685513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-8943072e-e740-4a52-a774-9caf9edb7209 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:01:45.685513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Jul 24 01:01:45.685513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: Jul 24 01:01:45.686521 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943072e-e740-4a52-a774-9caf9edb7209 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:45.699222 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 761/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Sun Jul 24 01:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:45.708148 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26fed5-4229-4d13-b2ba-5b34e76f19a9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:45.720712 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26fed5-4229-4d13-b2ba-5b34e76f19a9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:45.784836 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:45.817981 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb1404-34f8-4a72-8f4e-25a00b392fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:45.818641 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb1404-34f8-4a72-8f4e-25a00b392fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:45.818920 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb1404-34f8-4a72-8f4e-25a00b392fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:45.819188 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb1404-34f8-4a72-8f4e-25a00b392fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:45.819870 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb1404-34f8-4a72-8f4e-25a00b392fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:45.821707 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-0bbb1404-34f8-4a72-8f4e-25a00b392fa7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:01:45.821707 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Jul 24 01:01:45.821707 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: Jul 24 01:01:45.822917 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb1404-34f8-4a72-8f4e-25a00b392fa7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:45.889272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 736/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Sun Jul 24 01:01:45 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:01:45.894368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943072e-e740-4a52-a774-9caf9edb7209 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:45.896666 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8943072e-e740-4a52-a774-9caf9edb7209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:45.936757 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943072e-e740-4a52-a774-9caf9edb7209 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:46.031435 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6884ba-fee6-4f48-b3dd-1aba5610fea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:46.032028 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6884ba-fee6-4f48-b3dd-1aba5610fea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:46.032285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6884ba-fee6-4f48-b3dd-1aba5610fea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:46.032583 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6884ba-fee6-4f48-b3dd-1aba5610fea1 admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:46.033293 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6884ba-fee6-4f48-b3dd-1aba5610fea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:46.034331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-eb6884ba-fee6-4f48-b3dd-1aba5610fea1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:01:46.034331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Jul 24 01:01:46.034331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: Jul 24 01:01:46.035538 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6884ba-fee6-4f48-b3dd-1aba5610fea1 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:46.078372 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 762/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Sun Jul 24 01:01:45 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:01:46.082581 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb1404-34f8-4a72-8f4e-25a00b392fa7 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:46.084468 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0bbb1404-34f8-4a72-8f4e-25a00b392fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:46.147360 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb1404-34f8-4a72-8f4e-25a00b392fa7 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:46.236262 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:46.248097 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4e51f-7bdd-45a0-891c-2291cdce0c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:46.248820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4e51f-7bdd-45a0-891c-2291cdce0c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:46.249100 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4e51f-7bdd-45a0-891c-2291cdce0c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:46.249397 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4e51f-7bdd-45a0-891c-2291cdce0c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:46.250158 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4e51f-7bdd-45a0-891c-2291cdce0c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:46.251188 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-e9d4e51f-7bdd-45a0-891c-2291cdce0c16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:01:46.251188 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Jul 24 01:01:46.251188 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: Jul 24 01:01:46.252077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4e51f-7bdd-45a0-891c-2291cdce0c16 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:46.264895 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 737/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Sun Jul 24 01:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:01:46.269235 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6884ba-fee6-4f48-b3dd-1aba5610fea1 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:46.270794 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-eb6884ba-fee6-4f48-b3dd-1aba5610fea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:46.282342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6884ba-fee6-4f48-b3dd-1aba5610fea1 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:46.307601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:46.387810 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd38bb5-46f8-48f2-ba0b-f9bc800ce090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:46.388478 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd38bb5-46f8-48f2-ba0b-f9bc800ce090 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:46.388761 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd38bb5-46f8-48f2-ba0b-f9bc800ce090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:46.389033 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd38bb5-46f8-48f2-ba0b-f9bc800ce090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:46.389796 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd38bb5-46f8-48f2-ba0b-f9bc800ce090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:46.390824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-3cd38bb5-46f8-48f2-ba0b-f9bc800ce090 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:01:46.390824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Jul 24 01:01:46.390824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: Jul 24 01:01:46.391705 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd38bb5-46f8-48f2-ba0b-f9bc800ce090 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:46.404750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 763/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Sun Jul 24 01:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:01:46.409286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4e51f-7bdd-45a0-891c-2291cdce0c16 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:46.410847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e9d4e51f-7bdd-45a0-891c-2291cdce0c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:46.445214 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4e51f-7bdd-45a0-891c-2291cdce0c16 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:46.566203 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7afc7a-b640-4077-9142-4627db6cd79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:46.567011 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7afc7a-b640-4077-9142-4627db6cd79e admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:46.567290 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7afc7a-b640-4077-9142-4627db6cd79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:46.567562 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7afc7a-b640-4077-9142-4627db6cd79e admin admin] PATH_INFO: `/v3/projects/9341d36a9a0a43fbbd72035feecd45f2/users/82b6a3241d8f47fba24423b4318d6abc/roles/2099e2212de24144b089730e7db8ed3a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:46.591529 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7afc7a-b640-4077-9142-4627db6cd79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9341d36a9a0a43fbbd72035feecd45f2, user_id=82b6a3241d8f47fba24423b4318d6abc, role_id=2099e2212de24144b089730e7db8ed3a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:46.592593 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-fb7afc7a-b640-4077-9142-4627db6cd79e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:01:46.592593 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Jul 24 01:01:46.592593 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: Jul 24 01:01:46.594580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7afc7a-b640-4077-9142-4627db6cd79e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:46.620796 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 738/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Sun Jul 24 01:01:46 2022] PUT /identity/v3/projects/9341d36a9a0a43fbbd72035feecd45f2/users/82b6a3241d8f47fba24423b4318d6abc/roles/2099e2212de24144b089730e7db8ed3a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:01:46.633603 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591f0e8-97f9-4fad-a3df-dbcd3c0ba62f None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:46.633864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591f0e8-97f9-4fad-a3df-dbcd3c0ba62f None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:46.634174 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591f0e8-97f9-4fad-a3df-dbcd3c0ba62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:46.690887 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c591f0e8-97f9-4fad-a3df-dbcd3c0ba62f None None] MFA Rules not processed for user `82b6a3241d8f47fba24423b4318d6abc`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:46.692132 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c591f0e8-97f9-4fad-a3df-dbcd3c0ba62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:46.782913 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 764/1502] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:01:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:01:46.799716 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935f385-98f3-47e2-8bb0-3ad63dac37aa None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:46.800057 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935f385-98f3-47e2-8bb0-3ad63dac37aa None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:46.800401 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935f385-98f3-47e2-8bb0-3ad63dac37aa None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:46.802585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 739/1503] 10.222.0.43 () {54 vars in 964 bytes} [Sun Jul 24 01:01:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:01:46.809584 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd5275-12f9-449b-8afd-d4669d3f11a6 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:46.809878 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd5275-12f9-449b-8afd-d4669d3f11a6 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:46.810152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd5275-12f9-449b-8afd-d4669d3f11a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:46.842382 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:46.888290 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-39fd5275-12f9-449b-8afd-d4669d3f11a6 None None] MFA Rules not processed for user `6c87c6bb14d74884a8c4ff8915d2494e`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:46.889550 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-39fd5275-12f9-449b-8afd-d4669d3f11a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:46.973054 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 765/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Sun Jul 24 01:01:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:01:46.980812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935f385-98f3-47e2-8bb0-3ad63dac37aa None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:46.982473 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b935f385-98f3-47e2-8bb0-3ad63dac37aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:47.038237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:47.097788 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935f385-98f3-47e2-8bb0-3ad63dac37aa None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:47.188412 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef3391-e86a-4695-b8c5-ecd78aa74874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c87c6bb14d74884a8c4ff8915d2494e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:47.189077 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef3391-e86a-4695-b8c5-ecd78aa74874 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:47.189398 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef3391-e86a-4695-b8c5-ecd78aa74874 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:47.189674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef3391-e86a-4695-b8c5-ecd78aa74874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:47.191414 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0bef3391-e86a-4695-b8c5-ecd78aa74874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:47.301357 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef3391-e86a-4695-b8c5-ecd78aa74874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:47.302812 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef3391-e86a-4695-b8c5-ecd78aa74874 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:47.306447 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:47.325089 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 740/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:01:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:01:47.372112 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5e39d-fc61-4864-a688-29f031b17dca None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:47.372810 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5e39d-fc61-4864-a688-29f031b17dca None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:47.372907 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5e39d-fc61-4864-a688-29f031b17dca None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:47.374922 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 766/1506] 10.222.0.43 () {52 vars in 829 bytes} [Sun Jul 24 01:01:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:01:47.379106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef3391-e86a-4695-b8c5-ecd78aa74874 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:47.380352 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0bef3391-e86a-4695-b8c5-ecd78aa74874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:47.495200 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef3391-e86a-4695-b8c5-ecd78aa74874 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:47.600115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:47.601006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:47.601328 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:47.601607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] PATH_INFO: `/v3/users/82b6a3241d8f47fba24423b4318d6abc` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:47.616623 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b6a3241d8f47fba24423b4318d6abc)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:47.617655 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:01:47.617655 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Jul 24 01:01:47.617655 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: Jul 24 01:01:47.618878 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:47.629508 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:47.690814 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b6a3241d8f47fba24423b4318d6abc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:01:47.700484 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b6a3241d8f47fba24423b4318d6abc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:01:47.715571 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b6a3241d8f47fba24423b4318d6abc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:01:47.716147 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b6a3241d8f47fba24423b4318d6abc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:01:47.716565 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b6a3241d8f47fba24423b4318d6abc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:01:47.745048 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 741/1507] 10.222.0.43 () {58 vars in 1223 bytes} [Sun Jul 24 01:01:47 2022] DELETE /identity/v3/users/82b6a3241d8f47fba24423b4318d6abc => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:01:47.751235 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d2cb5-d5a4-4768-8b9b-2df3a3f87f63 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:47.751520 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d2cb5-d5a4-4768-8b9b-2df3a3f87f63 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:47.751818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d2cb5-d5a4-4768-8b9b-2df3a3f87f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:47.819885 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-cb7d2cb5-d5a4-4768-8b9b-2df3a3f87f63 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:47.821499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-cb7d2cb5-d5a4-4768-8b9b-2df3a3f87f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:47.907071 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:47.920777 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 767/1508] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:01:47.931209 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:47.932453 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:48.048391 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00822f02-3030-42d9-ab3b-a13b9467b5b2 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:48.105000 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:48.128183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dceff-348b-4fc9-974a-039e6122786a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:48.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dceff-348b-4fc9-974a-039e6122786a service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:48.129122 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dceff-348b-4fc9-974a-039e6122786a service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:48.129419 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dceff-348b-4fc9-974a-039e6122786a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:48.131099 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0f8dceff-348b-4fc9-974a-039e6122786a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:48.383408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8dceff-348b-4fc9-974a-039e6122786a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:48.385500 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8dceff-348b-4fc9-974a-039e6122786a service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:48.404744 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 742/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:01:48.779226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d2cb5-d5a4-4768-8b9b-2df3a3f87f63 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:48.780479 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-cb7d2cb5-d5a4-4768-8b9b-2df3a3f87f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:48.792092 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d2cb5-d5a4-4768-8b9b-2df3a3f87f63 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:48.897081 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:48.897985 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:48.898267 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:48.898561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] PATH_INFO: `/v3/projects/9341d36a9a0a43fbbd72035feecd45f2` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:48.908834 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9341d36a9a0a43fbbd72035feecd45f2)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:48.909910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:01:48.909910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Jul 24 01:01:48.909910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: Jul 24 01:01:48.911115 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:48.972115 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9341d36a9a0a43fbbd72035feecd45f2', 'request_id': 'req-6227e155-fbab-41d5-8584-82cf74197f98'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:01:48.987189 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9341d36a9a0a43fbbd72035feecd45f2', 'request_id': 'req-6227e155-fbab-41d5-8584-82cf74197f98'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:01:48.997615 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9341d36a9a0a43fbbd72035feecd45f2', 'request_id': 'req-6227e155-fbab-41d5-8584-82cf74197f98'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:01:49.025163 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] The token cache is being invalidate because project 9341d36a9a0a43fbbd72035feecd45f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:01:49.025441 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:01:49.025980 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-6227e155-fbab-41d5-8584-82cf74197f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:01:49.027332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 768/1510] 10.222.0.43 () {58 vars in 1232 bytes} [Sun Jul 24 01:01:48 2022] DELETE /identity/v3/projects/9341d36a9a0a43fbbd72035feecd45f2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:01:58.402520 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=62 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:59.023025 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:03.952784 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60875949-0423-4cb2-a120-e31345cae776 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:03.953767 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60875949-0423-4cb2-a120-e31345cae776 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:03.953767 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60875949-0423-4cb2-a120-e31345cae776 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:03.955991 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 743/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:03:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:03.962310 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e868d-55af-46d6-bf18-bbe34cebda14 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:03.962990 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e868d-55af-46d6-bf18-bbe34cebda14 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:03.963101 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e868d-55af-46d6-bf18-bbe34cebda14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:04.058580 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-815e868d-55af-46d6-bf18-bbe34cebda14 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:04.059793 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-815e868d-55af-46d6-bf18-bbe34cebda14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:04.185594 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 769/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:04.340809 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60875949-0423-4cb2-a120-e31345cae776 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:04.344767 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-60875949-0423-4cb2-a120-e31345cae776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:04.482544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60875949-0423-4cb2-a120-e31345cae776 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:04.488471 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef90db-4e9b-4907-a1d5-f32e6726c5c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:04.489123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef90db-4e9b-4907-a1d5-f32e6726c5c2 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:04.489472 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef90db-4e9b-4907-a1d5-f32e6726c5c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:04.489753 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef90db-4e9b-4907-a1d5-f32e6726c5c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:04.498093 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef90db-4e9b-4907-a1d5-f32e6726c5c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:04.499696 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef90db-4e9b-4907-a1d5-f32e6726c5c2 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:04.509266 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 744/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:05.333276 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748286f7-7491-46cd-8a89-9f71d9e759aa None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:05.333937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748286f7-7491-46cd-8a89-9f71d9e759aa None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:05.333937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748286f7-7491-46cd-8a89-9f71d9e759aa None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:05.335608 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 770/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:05.341655 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605aef6-87e7-491b-a510-a17d9d7f9635 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:05.342115 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605aef6-87e7-491b-a510-a17d9d7f9635 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:05.342226 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605aef6-87e7-491b-a510-a17d9d7f9635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:05.368053 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1605aef6-87e7-491b-a510-a17d9d7f9635 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:05.369285 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1605aef6-87e7-491b-a510-a17d9d7f9635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:05.378235 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 745/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:05.532122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748286f7-7491-46cd-8a89-9f71d9e759aa None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:05.550530 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748286f7-7491-46cd-8a89-9f71d9e759aa None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:05.556499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf46bfb-b3e7-410d-8fce-0adfb110e3b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:05.557155 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf46bfb-b3e7-410d-8fce-0adfb110e3b5 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:05.557482 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf46bfb-b3e7-410d-8fce-0adfb110e3b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:05.557757 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf46bfb-b3e7-410d-8fce-0adfb110e3b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:05.566001 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf46bfb-b3e7-410d-8fce-0adfb110e3b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:05.567685 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf46bfb-b3e7-410d-8fce-0adfb110e3b5 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:05.577509 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 771/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:08.418765 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a50535-0da4-4e79-9645-306f5c686edc None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:08.419347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a50535-0da4-4e79-9645-306f5c686edc None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:08.419347 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a50535-0da4-4e79-9645-306f5c686edc None None] PATH_INFO: `/v3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:08.420664 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 746/1517] 10.222.0.48 () {54 vars in 925 bytes} [Sun Jul 24 01:03:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:03:08.428336 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9ef12-55a5-4ddc-a08e-4aa9f030e101 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:08.428776 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9ef12-55a5-4ddc-a08e-4aa9f030e101 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:08.428888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9ef12-55a5-4ddc-a08e-4aa9f030e101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:08.499048 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-94e9ef12-55a5-4ddc-a08e-4aa9f030e101 None None] MFA Rules not processed for user `cce671a84420484580cfd8efe6a6e227`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:08.500289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-94e9ef12-55a5-4ddc-a08e-4aa9f030e101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:08.521392 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:08.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 772/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Sun Jul 24 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:15.362387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=56 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:16.829088 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e1a4d-1e66-4664-8d01-56f2c9e1e148 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:16.830132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e1a4d-1e66-4664-8d01-56f2c9e1e148 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:16.830132 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e1a4d-1e66-4664-8d01-56f2c9e1e148 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:16.832047 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 747/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:03:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:16.837560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeab4f2-0a43-436b-bdd3-e2438539bc45 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:16.838007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeab4f2-0a43-436b-bdd3-e2438539bc45 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:16.838007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeab4f2-0a43-436b-bdd3-e2438539bc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:16.857762 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-abeab4f2-0a43-436b-bdd3-e2438539bc45 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:16.858949 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-abeab4f2-0a43-436b-bdd3-e2438539bc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:16.867283 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 773/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:17.024929 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e1a4d-1e66-4664-8d01-56f2c9e1e148 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:17.040247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e1a4d-1e66-4664-8d01-56f2c9e1e148 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:17.045968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21c2d1-81e4-40f6-9bd4-587aaa8c61cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:17.046683 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21c2d1-81e4-40f6-9bd4-587aaa8c61cf service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:17.046961 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21c2d1-81e4-40f6-9bd4-587aaa8c61cf service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:17.047234 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21c2d1-81e4-40f6-9bd4-587aaa8c61cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:17.055618 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21c2d1-81e4-40f6-9bd4-587aaa8c61cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:17.057182 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21c2d1-81e4-40f6-9bd4-587aaa8c61cf service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:17.067501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 748/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:17.357789 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e1aa5-f1b7-4a70-8e0f-704bd62290c0 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:17.358011 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e1aa5-f1b7-4a70-8e0f-704bd62290c0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:17.358280 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e1aa5-f1b7-4a70-8e0f-704bd62290c0 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:17.359721 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 774/1522] 10.222.0.43 () {54 vars in 961 bytes} [Sun Jul 24 01:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:17.364917 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746577f8-067d-4f5d-8158-a0e3366e2807 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:17.365180 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746577f8-067d-4f5d-8158-a0e3366e2807 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:17.365520 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746577f8-067d-4f5d-8158-a0e3366e2807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:17.383852 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-746577f8-067d-4f5d-8158-a0e3366e2807 None None] MFA Rules not processed for user `cce671a84420484580cfd8efe6a6e227`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:17.385055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-746577f8-067d-4f5d-8158-a0e3366e2807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:17.393807 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 749/1523] 10.222.0.43 () {58 vars in 1058 bytes} [Sun Jul 24 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:17.401235 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e1aa5-f1b7-4a70-8e0f-704bd62290c0 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:17.417812 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e1aa5-f1b7-4a70-8e0f-704bd62290c0 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:17.422817 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58f627-f755-4f84-8686-8dcb935cf6d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce671a84420484580cfd8efe6a6e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:17.423454 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58f627-f755-4f84-8686-8dcb935cf6d7 service placement] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:17.423732 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58f627-f755-4f84-8686-8dcb935cf6d7 service placement] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:17.424010 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58f627-f755-4f84-8686-8dcb935cf6d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:17.432390 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58f627-f755-4f84-8686-8dcb935cf6d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:17.434056 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58f627-f755-4f84-8686-8dcb935cf6d7 service placement] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:17.443558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 775/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:17.897434 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01be6-dab9-47e4-aec0-fb34d87e0baf None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:17.897977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01be6-dab9-47e4-aec0-fb34d87e0baf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:17.897977 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01be6-dab9-47e4-aec0-fb34d87e0baf None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:17.899391 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:17.904664 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e4ac5-fa8a-4278-b41f-03e095ce5c21 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:17.905093 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e4ac5-fa8a-4278-b41f-03e095ce5c21 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:17.905230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e4ac5-fa8a-4278-b41f-03e095ce5c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:17.925233 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b59e4ac5-fa8a-4278-b41f-03e095ce5c21 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:17.926455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b59e4ac5-fa8a-4278-b41f-03e095ce5c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:17.935284 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:18.087723 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d01be6-dab9-47e4-aec0-fb34d87e0baf None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:18.102748 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d01be6-dab9-47e4-aec0-fb34d87e0baf None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:18.108689 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745047da-2443-4364-b213-ac091145e2d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:18.109392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745047da-2443-4364-b213-ac091145e2d7 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:18.109712 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745047da-2443-4364-b213-ac091145e2d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:18.109971 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745047da-2443-4364-b213-ac091145e2d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:18.119636 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745047da-2443-4364-b213-ac091145e2d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:18.121609 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745047da-2443-4364-b213-ac091145e2d7 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:18.133431 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 751/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:22.013323 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800487c-646b-444c-af10-ea74bcf866a2 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:22.013896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800487c-646b-444c-af10-ea74bcf866a2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:22.013896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800487c-646b-444c-af10-ea74bcf866a2 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:22.015287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:22.021778 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1989bfd-5e82-4054-8851-4d74ea4112d4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:22.022243 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1989bfd-5e82-4054-8851-4d74ea4112d4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:22.022340 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1989bfd-5e82-4054-8851-4d74ea4112d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:22.043140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c1989bfd-5e82-4054-8851-4d74ea4112d4 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:22.044341 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c1989bfd-5e82-4054-8851-4d74ea4112d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:22.053262 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:22.132109 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800487c-646b-444c-af10-ea74bcf866a2 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:22.134300 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d800487c-646b-444c-af10-ea74bcf866a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:22.219512 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800487c-646b-444c-af10-ea74bcf866a2 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:22.223496 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc400640-7a63-44a8-bcf4-062a29ac6c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:22.224224 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc400640-7a63-44a8-bcf4-062a29ac6c32 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:22.224502 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc400640-7a63-44a8-bcf4-062a29ac6c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:22.224773 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc400640-7a63-44a8-bcf4-062a29ac6c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:22.234699 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc400640-7a63-44a8-bcf4-062a29ac6c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:22.236138 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc400640-7a63-44a8-bcf4-062a29ac6c32 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:22.246070 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 778/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:24.271695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6504b09-ab5b-4bbe-aec1-8361b69b630d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:24.272540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6504b09-ab5b-4bbe-aec1-8361b69b630d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:24.272540 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6504b09-ab5b-4bbe-aec1-8361b69b630d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:24.274746 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:03:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:24.281102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5974fb-3c4b-428f-9ff1-7248d6c15446 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:24.281573 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5974fb-3c4b-428f-9ff1-7248d6c15446 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:24.281724 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5974fb-3c4b-428f-9ff1-7248d6c15446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:24.303204 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-2b5974fb-3c4b-428f-9ff1-7248d6c15446 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:24.304426 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2b5974fb-3c4b-428f-9ff1-7248d6c15446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:24.313675 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:24.352219 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6504b09-ab5b-4bbe-aec1-8361b69b630d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:24.364669 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6504b09-ab5b-4bbe-aec1-8361b69b630d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:24.368895 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3af63a-b003-4e26-8652-15dfe8994538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:24.369580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3af63a-b003-4e26-8652-15dfe8994538 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:24.369865 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3af63a-b003-4e26-8652-15dfe8994538 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:24.370138 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3af63a-b003-4e26-8652-15dfe8994538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:24.382570 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3af63a-b003-4e26-8652-15dfe8994538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:24.384016 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3af63a-b003-4e26-8652-15dfe8994538 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:24.393850 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 754/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:28.115113 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70256084-df6a-49a6-b978-3fb2b7d9b88a None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:28.115682 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70256084-df6a-49a6-b978-3fb2b7d9b88a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:28.115682 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70256084-df6a-49a6-b978-3fb2b7d9b88a None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:28.117058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:28.122550 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7a1c-8851-42e7-84b1-5b8c9ee24ae4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:28.122996 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7a1c-8851-42e7-84b1-5b8c9ee24ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:28.123105 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7a1c-8851-42e7-84b1-5b8c9ee24ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:28.143845 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-071c7a1c-8851-42e7-84b1-5b8c9ee24ae4 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:28.145324 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-071c7a1c-8851-42e7-84b1-5b8c9ee24ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:28.154453 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:28.465444 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70256084-df6a-49a6-b978-3fb2b7d9b88a None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:28.468765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-70256084-df6a-49a6-b978-3fb2b7d9b88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:28.547536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=100 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:28.563218 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70256084-df6a-49a6-b978-3fb2b7d9b88a None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:28.567230 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb9233-e6f9-4cb7-b811-e9bcede045a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c87c6bb14d74884a8c4ff8915d2494e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:28.567910 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb9233-e6f9-4cb7-b811-e9bcede045a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:28.568193 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb9233-e6f9-4cb7-b811-e9bcede045a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:28.568468 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb9233-e6f9-4cb7-b811-e9bcede045a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:28.578355 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb9233-e6f9-4cb7-b811-e9bcede045a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:28.579803 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb9233-e6f9-4cb7-b811-e9bcede045a4 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:28.590808 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 781/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:30.621994 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee718713-99ca-4a1b-973a-d9ef97d067bd None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:30.622496 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee718713-99ca-4a1b-973a-d9ef97d067bd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:30.622496 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee718713-99ca-4a1b-973a-d9ef97d067bd None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:30.623928 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:30.629560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842171f-edfe-4469-8cf5-f7abdc4d842d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:30.630116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842171f-edfe-4469-8cf5-f7abdc4d842d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:30.630116 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842171f-edfe-4469-8cf5-f7abdc4d842d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:30.651383 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b842171f-edfe-4469-8cf5-f7abdc4d842d None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:30.652599 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b842171f-edfe-4469-8cf5-f7abdc4d842d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:30.662451 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:30.967529 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee718713-99ca-4a1b-973a-d9ef97d067bd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:30.970834 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ee718713-99ca-4a1b-973a-d9ef97d067bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:30.992263 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee718713-99ca-4a1b-973a-d9ef97d067bd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:30.996537 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a362b28-f2e5-47ce-8fdb-214ad6158391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c87c6bb14d74884a8c4ff8915d2494e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:30.997186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a362b28-f2e5-47ce-8fdb-214ad6158391 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:30.997501 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a362b28-f2e5-47ce-8fdb-214ad6158391 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:30.997781 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a362b28-f2e5-47ce-8fdb-214ad6158391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:31.007445 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a362b28-f2e5-47ce-8fdb-214ad6158391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:31.008874 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a362b28-f2e5-47ce-8fdb-214ad6158391 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:31.018577 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 757/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:40.646058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=11 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:41.014512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=33 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:53.171739 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d222fa4-f4b1-4f48-85e1-3cfcb3a08de0 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.172467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d222fa4-f4b1-4f48-85e1-3cfcb3a08de0 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.172467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d222fa4-f4b1-4f48-85e1-3cfcb3a08de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.190867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4d222fa4-f4b1-4f48-85e1-3cfcb3a08de0 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:53.192065 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4d222fa4-f4b1-4f48-85e1-3cfcb3a08de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:53.197498 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4cc06-5b97-4377-961c-95159127301d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.198033 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4cc06-5b97-4377-961c-95159127301d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.198140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4cc06-5b97-4377-961c-95159127301d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.200830 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 783/1540] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:53.208925 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c10ac0-5ced-454b-bf67-9e2010dddebe None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.209236 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c10ac0-5ced-454b-bf67-9e2010dddebe None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.209524 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c10ac0-5ced-454b-bf67-9e2010dddebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.217993 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f3e4cc06-5b97-4377-961c-95159127301d None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:53.219197 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f3e4cc06-5b97-4377-961c-95159127301d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:53.228024 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d1c10ac0-5ced-454b-bf67-9e2010dddebe None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:53.228178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 758/1541] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:53.229251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d1c10ac0-5ced-454b-bf67-9e2010dddebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:53.236608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145c9e1-78b6-4c88-a318-ba42ea468628 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.236902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145c9e1-78b6-4c88-a318-ba42ea468628 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.237242 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145c9e1-78b6-4c88-a318-ba42ea468628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.240888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 784/1542] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:04:53.241767 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c10ac0-5ced-454b-bf67-9e2010dddebe None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.251484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c10ac0-5ced-454b-bf67-9e2010dddebe None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.258203 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cfbe7-0223-45e9-97d1-ce95f67274de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.258805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d145c9e1-78b6-4c88-a318-ba42ea468628 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:53.258942 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cfbe7-0223-45e9-97d1-ce95f67274de admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.259158 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cfbe7-0223-45e9-97d1-ce95f67274de admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.259430 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cfbe7-0223-45e9-97d1-ce95f67274de admin admin] PATH_INFO: `/v3/domains` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.260035 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d145c9e1-78b6-4c88-a318-ba42ea468628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:53.260195 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cfbe7-0223-45e9-97d1-ce95f67274de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:04:53.260532 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cfbe7-0223-45e9-97d1-ce95f67274de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.262166 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cfbe7-0223-45e9-97d1-ce95f67274de admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.268383 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 759/1543] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:04:53.273126 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145c9e1-78b6-4c88-a318-ba42ea468628 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.277232 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 785/1544] 10.222.0.43 () {58 vars in 1152 bytes} [Sun Jul 24 01:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:04:53.282519 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cfbe7-0223-45e9-97d1-ce95f67274de admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.282669 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145c9e1-78b6-4c88-a318-ba42ea468628 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.287629 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d5c98-714e-4899-ab77-bdc14908d751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.288286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d5c98-714e-4899-ab77-bdc14908d751 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.288898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d5c98-714e-4899-ab77-bdc14908d751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.288898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d5c98-714e-4899-ab77-bdc14908d751 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.289598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d5c98-714e-4899-ab77-bdc14908d751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:04:53.289902 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d5c98-714e-4899-ab77-bdc14908d751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.290939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-c71d5c98-714e-4899-ab77-bdc14908d751 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:04:53.290939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Jul 24 01:04:53.290939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: Jul 24 01:04:53.291847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d5c98-714e-4899-ab77-bdc14908d751 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.292256 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cfbe7-0223-45e9-97d1-ce95f67274de admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.297314 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fd3ed-dcd5-4df0-8a0e-433e6030179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.297965 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fd3ed-dcd5-4df0-8a0e-433e6030179b admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.298243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fd3ed-dcd5-4df0-8a0e-433e6030179b admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.298514 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fd3ed-dcd5-4df0-8a0e-433e6030179b admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.299195 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fd3ed-dcd5-4df0-8a0e-433e6030179b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.300199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-fe0fd3ed-dcd5-4df0-8a0e-433e6030179b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:04:53.300199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Jul 24 01:04:53.300199 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: Jul 24 01:04:53.301396 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fd3ed-dcd5-4df0-8a0e-433e6030179b admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.304066 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 760/1545] 10.222.0.43 () {58 vars in 1152 bytes} [Sun Jul 24 01:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:04:53.312285 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d5c98-714e-4899-ab77-bdc14908d751 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.321915 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d5c98-714e-4899-ab77-bdc14908d751 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.326585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e2fa3-1802-42c8-8dd7-92449338e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.327526 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e2fa3-1802-42c8-8dd7-92449338e8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.327847 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e2fa3-1802-42c8-8dd7-92449338e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.328099 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e2fa3-1802-42c8-8dd7-92449338e8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.329045 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e2fa3-1802-42c8-8dd7-92449338e8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.331394 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e2fa3-1802-42c8-8dd7-92449338e8a9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.340542 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 786/1546] 10.222.0.43 () {60 vars in 1152 bytes} [Sun Jul 24 01:04:53 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:04:53.341554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fd3ed-dcd5-4df0-8a0e-433e6030179b admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.361022 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 761/1547] 10.222.0.43 () {60 vars in 1152 bytes} [Sun Jul 24 01:04:53 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:04:53.365658 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e2fa3-1802-42c8-8dd7-92449338e8a9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.406250 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fd3ed-dcd5-4df0-8a0e-433e6030179b admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.426853 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e2fa3-1802-42c8-8dd7-92449338e8a9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.431737 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6cf2f-4f06-4f59-ab71-5bdeecfb2fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.432422 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6cf2f-4f06-4f59-ab71-5bdeecfb2fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.432727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6cf2f-4f06-4f59-ab71-5bdeecfb2fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.433039 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6cf2f-4f06-4f59-ab71-5bdeecfb2fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.433772 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6cf2f-4f06-4f59-ab71-5bdeecfb2fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.434805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-21b6cf2f-4f06-4f59-ab71-5bdeecfb2fd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:04:53.434805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: warnings.warn(msg) Jul 24 01:04:53.434805 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: Jul 24 01:04:53.436011 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6cf2f-4f06-4f59-ab71-5bdeecfb2fd0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.456998 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 762/1548] 10.222.0.43 () {60 vars in 1143 bytes} [Sun Jul 24 01:04:53 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:04:53.461715 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6cf2f-4f06-4f59-ab71-5bdeecfb2fd0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.464874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83882b8d-c4d9-4953-9880-d18c749cf95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.465626 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83882b8d-c4d9-4953-9880-d18c749cf95e admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.465911 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83882b8d-c4d9-4953-9880-d18c749cf95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.466191 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83882b8d-c4d9-4953-9880-d18c749cf95e admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.467070 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83882b8d-c4d9-4953-9880-d18c749cf95e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.469580 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83882b8d-c4d9-4953-9880-d18c749cf95e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.471619 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6cf2f-4f06-4f59-ab71-5bdeecfb2fd0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.476453 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65427fa-cb5a-4ce4-9cd5-ca9b47f1113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.477090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65427fa-cb5a-4ce4-9cd5-ca9b47f1113a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.477820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65427fa-cb5a-4ce4-9cd5-ca9b47f1113a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.477820 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65427fa-cb5a-4ce4-9cd5-ca9b47f1113a admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.478531 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65427fa-cb5a-4ce4-9cd5-ca9b47f1113a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.480335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65427fa-cb5a-4ce4-9cd5-ca9b47f1113a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.494575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 787/1549] 10.222.0.43 () {60 vars in 1143 bytes} [Sun Jul 24 01:04:53 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:04:53.494826 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 763/1550] 10.222.0.43 () {58 vars in 1121 bytes} [Sun Jul 24 01:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:04:53.496171 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65427fa-cb5a-4ce4-9cd5-ca9b47f1113a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.496290 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83882b8d-c4d9-4953-9880-d18c749cf95e admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.506324 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65427fa-cb5a-4ce4-9cd5-ca9b47f1113a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.506558 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83882b8d-c4d9-4953-9880-d18c749cf95e admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.511238 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddd5c6-af29-4920-ae4b-04eecad6a9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.511408 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7627e9-bb89-4f6c-bf95-47d50decf0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.511869 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd5c6-af29-4920-ae4b-04eecad6a9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.512071 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7627e9-bb89-4f6c-bf95-47d50decf0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.512178 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd5c6-af29-4920-ae4b-04eecad6a9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.512352 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7627e9-bb89-4f6c-bf95-47d50decf0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd5c6-af29-4920-ae4b-04eecad6a9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.512620 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7627e9-bb89-4f6c-bf95-47d50decf0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.513139 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddd5c6-af29-4920-ae4b-04eecad6a9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.513398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7627e9-bb89-4f6c-bf95-47d50decf0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.514790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddd5c6-af29-4920-ae4b-04eecad6a9d5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.515242 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7627e9-bb89-4f6c-bf95-47d50decf0c6 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.524906 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 764/1551] 10.222.0.43 () {58 vars in 1121 bytes} [Sun Jul 24 01:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:04:53.528258 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 788/1552] 10.222.0.43 () {58 vars in 1121 bytes} [Sun Jul 24 01:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:04:53.528914 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddd5c6-af29-4920-ae4b-04eecad6a9d5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.529339 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7627e9-bb89-4f6c-bf95-47d50decf0c6 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.538573 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddd5c6-af29-4920-ae4b-04eecad6a9d5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.539075 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7627e9-bb89-4f6c-bf95-47d50decf0c6 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.543326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97115526-4ad8-4abd-ad4c-dc6049ea3d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.543988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c3da5-8a87-406c-b9b2-b22521d582de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.544201 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97115526-4ad8-4abd-ad4c-dc6049ea3d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.544480 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97115526-4ad8-4abd-ad4c-dc6049ea3d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.544635 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c3da5-8a87-406c-b9b2-b22521d582de admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.544736 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97115526-4ad8-4abd-ad4c-dc6049ea3d4a admin admin] PATH_INFO: `/v3/projects/9c50636505744add842f10a8ccbc13d2/users/f31c423447a74d4d9411e20528726579/roles/2099e2212de24144b089730e7db8ed3a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.545060 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c3da5-8a87-406c-b9b2-b22521d582de admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.545377 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c3da5-8a87-406c-b9b2-b22521d582de admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.546101 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c3da5-8a87-406c-b9b2-b22521d582de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.547700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c3da5-8a87-406c-b9b2-b22521d582de admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.558303 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 789/1553] 10.222.0.43 () {58 vars in 1121 bytes} [Sun Jul 24 01:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:04:53.559358 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97115526-4ad8-4abd-ad4c-dc6049ea3d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c50636505744add842f10a8ccbc13d2, user_id=f31c423447a74d4d9411e20528726579, role_id=2099e2212de24144b089730e7db8ed3a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.562106 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97115526-4ad8-4abd-ad4c-dc6049ea3d4a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.562357 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c3da5-8a87-406c-b9b2-b22521d582de admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.573227 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c3da5-8a87-406c-b9b2-b22521d582de admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.577413 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 765/1554] 10.222.0.43 () {60 vars in 1482 bytes} [Sun Jul 24 01:04:53 2022] PUT /identity/v3/projects/9c50636505744add842f10a8ccbc13d2/users/f31c423447a74d4d9411e20528726579/roles/2099e2212de24144b089730e7db8ed3a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:04:53.582493 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467dede5-7dce-4a10-950a-6da36e20db56 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.582786 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467dede5-7dce-4a10-950a-6da36e20db56 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.583059 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467dede5-7dce-4a10-950a-6da36e20db56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.591134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:53.600779 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-467dede5-7dce-4a10-950a-6da36e20db56 None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:53.602045 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-467dede5-7dce-4a10-950a-6da36e20db56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:53.637179 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5b7ef-4f11-465b-a816-253f4d09ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.638374 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5b7ef-4f11-465b-a816-253f4d09ca16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.638654 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5b7ef-4f11-465b-a816-253f4d09ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.638928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5b7ef-4f11-465b-a816-253f4d09ca16 admin admin] PATH_INFO: `/v3/projects/bb9b9924c22449a4b04ea0c0e302b701/users/8f892a8269184083b896a720ea87de05/roles/2099e2212de24144b089730e7db8ed3a` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.649128 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:53.654874 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5b7ef-4f11-465b-a816-253f4d09ca16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9b9924c22449a4b04ea0c0e302b701, user_id=8f892a8269184083b896a720ea87de05, role_id=2099e2212de24144b089730e7db8ed3a)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.656022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: WARNING py.warnings [None req-fef5b7ef-4f11-465b-a816-253f4d09ca16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:04:53.656022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: warnings.warn(msg) Jul 24 01:04:53.656022 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: Jul 24 01:04:53.658007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5b7ef-4f11-465b-a816-253f4d09ca16 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.661699 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 766/1555] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:04:53.672487 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 790/1556] 10.222.0.43 () {60 vars in 1482 bytes} [Sun Jul 24 01:04:53 2022] PUT /identity/v3/projects/bb9b9924c22449a4b04ea0c0e302b701/users/8f892a8269184083b896a720ea87de05/roles/2099e2212de24144b089730e7db8ed3a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:04:53.672929 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467dede5-7dce-4a10-950a-6da36e20db56 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.677674 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb192ead-697e-48ba-9f3f-ffd5e18d9c2b None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.678082 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb192ead-697e-48ba-9f3f-ffd5e18d9c2b None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.678395 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb192ead-697e-48ba-9f3f-ffd5e18d9c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.694741 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-fb192ead-697e-48ba-9f3f-ffd5e18d9c2b None None] MFA Rules not processed for user `dbbb04324a8649df81c9f75c69605aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:53.695954 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-fb192ead-697e-48ba-9f3f-ffd5e18d9c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:53.728111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467dede5-7dce-4a10-950a-6da36e20db56 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.754708 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 791/1557] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:04:53.765313 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb192ead-697e-48ba-9f3f-ffd5e18d9c2b None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:53.777080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ca57d-541a-4b7c-bc1d-e72baf03f839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.777795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ca57d-541a-4b7c-bc1d-e72baf03f839 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.778082 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ca57d-541a-4b7c-bc1d-e72baf03f839 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.778359 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ca57d-541a-4b7c-bc1d-e72baf03f839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.788810 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ca57d-541a-4b7c-bc1d-e72baf03f839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.790272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ca57d-541a-4b7c-bc1d-e72baf03f839 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.800539 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 767/1558] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:04:53.825747 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb192ead-697e-48ba-9f3f-ffd5e18d9c2b None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:53.829639 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b0593-0f05-4ed4-93cf-5c307ffedf40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:53.830300 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b0593-0f05-4ed4-93cf-5c307ffedf40 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:53.830586 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b0593-0f05-4ed4-93cf-5c307ffedf40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:53.830863 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b0593-0f05-4ed4-93cf-5c307ffedf40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:53.840646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b0593-0f05-4ed4-93cf-5c307ffedf40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:53.842121 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b0593-0f05-4ed4-93cf-5c307ffedf40 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:53.851936 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 792/1559] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:58.634044 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf9418-62a7-4402-8c5d-4fe900d80620 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:58.634574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf9418-62a7-4402-8c5d-4fe900d80620 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:58.634574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf9418-62a7-4402-8c5d-4fe900d80620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:58.753277 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3fbf9418-62a7-4402-8c5d-4fe900d80620 None None] MFA Rules not processed for user `f31c423447a74d4d9411e20528726579`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:58.761736 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3fbf9418-62a7-4402-8c5d-4fe900d80620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:58.874612 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 768/1560] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:04:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:58.877095 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b0593-0f05-4ed4-93cf-5c307ffedf40 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:58.889743 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b0593-0f05-4ed4-93cf-5c307ffedf40 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:58.899168 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7114a17-6e6f-4df4-8a14-911d9e0610d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:58.900296 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7114a17-6e6f-4df4-8a14-911d9e0610d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:58.900779 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7114a17-6e6f-4df4-8a14-911d9e0610d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:58.901341 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7114a17-6e6f-4df4-8a14-911d9e0610d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:58.903554 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7114a17-6e6f-4df4-8a14-911d9e0610d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:58.909611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7114a17-6e6f-4df4-8a14-911d9e0610d7 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:58.974685 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 793/1561] 10.222.0.43 () {60 vars in 1152 bytes} [Sun Jul 24 01:04:58 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:04:58.975580 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf9418-62a7-4402-8c5d-4fe900d80620 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:58.993770 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf9418-62a7-4402-8c5d-4fe900d80620 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:59.063554 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:59.087739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2932273-5b93-4bfa-84ae-5f8ddf76318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:59.089179 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2932273-5b93-4bfa-84ae-5f8ddf76318d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:59.089649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2932273-5b93-4bfa-84ae-5f8ddf76318d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:59.090133 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2932273-5b93-4bfa-84ae-5f8ddf76318d admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:59.091110 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2932273-5b93-4bfa-84ae-5f8ddf76318d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:59.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2932273-5b93-4bfa-84ae-5f8ddf76318d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:59.132903 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 769/1562] 10.222.0.43 () {60 vars in 1143 bytes} [Sun Jul 24 01:04:58 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:04:59.138243 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7114a17-6e6f-4df4-8a14-911d9e0610d7 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:59.150175 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7114a17-6e6f-4df4-8a14-911d9e0610d7 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:59.156847 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1b596-ca2a-469c-a260-39395faacf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:59.157964 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1b596-ca2a-469c-a260-39395faacf68 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:59.158469 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1b596-ca2a-469c-a260-39395faacf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:59.158952 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1b596-ca2a-469c-a260-39395faacf68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:59.159895 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1b596-ca2a-469c-a260-39395faacf68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:59.161905 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1b596-ca2a-469c-a260-39395faacf68 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:59.181166 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 794/1563] 10.222.0.43 () {58 vars in 1121 bytes} [Sun Jul 24 01:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:04:59.182786 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2932273-5b93-4bfa-84ae-5f8ddf76318d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:59.200867 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2932273-5b93-4bfa-84ae-5f8ddf76318d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:59.215686 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeea75e-7530-4323-ae09-d7fbf6b28551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:59.217284 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeea75e-7530-4323-ae09-d7fbf6b28551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:59.219852 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeea75e-7530-4323-ae09-d7fbf6b28551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:59.220289 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeea75e-7530-4323-ae09-d7fbf6b28551 admin admin] PATH_INFO: `/v3/projects/938c7b3ecc1c43ad8570faedc072896d/users/bbde8079aa9c488a840b91b0e5fd0d90/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:59.242829 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeea75e-7530-4323-ae09-d7fbf6b28551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938c7b3ecc1c43ad8570faedc072896d, user_id=bbde8079aa9c488a840b91b0e5fd0d90, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:59.246549 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeea75e-7530-4323-ae09-d7fbf6b28551 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:59.272183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 770/1564] 10.222.0.43 () {60 vars in 1482 bytes} [Sun Jul 24 01:04:59 2022] PUT /identity/v3/projects/938c7b3ecc1c43ad8570faedc072896d/users/bbde8079aa9c488a840b91b0e5fd0d90/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:04:59.273991 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1b596-ca2a-469c-a260-39395faacf68 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:59.289331 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1b596-ca2a-469c-a260-39395faacf68 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:59.303391 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:59.432711 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28be448-ec67-422d-80b4-5b9340ba28c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:59.433453 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28be448-ec67-422d-80b4-5b9340ba28c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:59.433750 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28be448-ec67-422d-80b4-5b9340ba28c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:59.434031 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28be448-ec67-422d-80b4-5b9340ba28c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:59.434765 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28be448-ec67-422d-80b4-5b9340ba28c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:59.436404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28be448-ec67-422d-80b4-5b9340ba28c1 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:59.447394 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 795/1565] 10.222.0.43 () {58 vars in 1121 bytes} [Sun Jul 24 01:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:04:59.451771 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeea75e-7530-4323-ae09-d7fbf6b28551 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:59.477461 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeea75e-7530-4323-ae09-d7fbf6b28551 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:59.494768 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf92e2c-920a-48e0-963b-a267c2ff2764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:59.496032 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf92e2c-920a-48e0-963b-a267c2ff2764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:59.497697 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf92e2c-920a-48e0-963b-a267c2ff2764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:59.498503 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf92e2c-920a-48e0-963b-a267c2ff2764 admin admin] PATH_INFO: `/v3/projects/938c7b3ecc1c43ad8570faedc072896d/users/bbde8079aa9c488a840b91b0e5fd0d90/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:59.501924 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf92e2c-920a-48e0-963b-a267c2ff2764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938c7b3ecc1c43ad8570faedc072896d, user_id=bbde8079aa9c488a840b91b0e5fd0d90, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:59.505278 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf92e2c-920a-48e0-963b-a267c2ff2764 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:59.529518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 771/1566] 10.222.0.43 () {60 vars in 1482 bytes} [Sun Jul 24 01:04:59 2022] PUT /identity/v3/projects/938c7b3ecc1c43ad8570faedc072896d/users/bbde8079aa9c488a840b91b0e5fd0d90/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:04:59.633285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1372cef-28ec-468c-8c85-8267467798b6 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:59.633589 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1372cef-28ec-468c-8c85-8267467798b6 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:59.634332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1372cef-28ec-468c-8c85-8267467798b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:59.666791 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-a1372cef-28ec-468c-8c85-8267467798b6 None None] MFA Rules not processed for user `8f892a8269184083b896a720ea87de05`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:59.668289 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-a1372cef-28ec-468c-8c85-8267467798b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:59.782328 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 796/1567] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:04:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:59.782662 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf92e2c-920a-48e0-963b-a267c2ff2764 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:59.888795 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf92e2c-920a-48e0-963b-a267c2ff2764 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:59.894646 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee661a1-5351-4a5f-bd77-a798e1a9e4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:59.895552 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee661a1-5351-4a5f-bd77-a798e1a9e4fe admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:59.895942 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee661a1-5351-4a5f-bd77-a798e1a9e4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:59.896692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee661a1-5351-4a5f-bd77-a798e1a9e4fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:59.897615 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee661a1-5351-4a5f-bd77-a798e1a9e4fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:59.899791 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee661a1-5351-4a5f-bd77-a798e1a9e4fe admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:59.935806 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 772/1568] 10.222.0.43 () {60 vars in 1152 bytes} [Sun Jul 24 01:04:59 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:04:59.939951 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1372cef-28ec-468c-8c85-8267467798b6 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:59.951641 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1372cef-28ec-468c-8c85-8267467798b6 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:00.027703 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bb4ca-5536-44e4-9e4c-733b6c80a25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:00.028603 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bb4ca-5536-44e4-9e4c-733b6c80a25f admin admin] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:00.028982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bb4ca-5536-44e4-9e4c-733b6c80a25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:00.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bb4ca-5536-44e4-9e4c-733b6c80a25f admin admin] PATH_INFO: `/v3/users` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:00.030210 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bb4ca-5536-44e4-9e4c-733b6c80a25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:00.032398 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bb4ca-5536-44e4-9e4c-733b6c80a25f admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:00.064166 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 797/1569] 10.222.0.43 () {60 vars in 1143 bytes} [Sun Jul 24 01:04:59 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:05:00.068408 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee661a1-5351-4a5f-bd77-a798e1a9e4fe admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:00.079953 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee661a1-5351-4a5f-bd77-a798e1a9e4fe admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:00.086350 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7b0a6-8c4a-486b-8d3c-26b7a97721fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:00.087361 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7b0a6-8c4a-486b-8d3c-26b7a97721fb admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:00.087896 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7b0a6-8c4a-486b-8d3c-26b7a97721fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:00.088310 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7b0a6-8c4a-486b-8d3c-26b7a97721fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:00.089370 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7b0a6-8c4a-486b-8d3c-26b7a97721fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:00.091992 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7b0a6-8c4a-486b-8d3c-26b7a97721fb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:00.108259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 773/1570] 10.222.0.43 () {58 vars in 1121 bytes} [Sun Jul 24 01:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:05:00.109588 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bb4ca-5536-44e4-9e4c-733b6c80a25f admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:00.120982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bb4ca-5536-44e4-9e4c-733b6c80a25f admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:00.126869 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b945e-f11e-47a1-84e4-a73e00de078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:00.128006 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b945e-f11e-47a1-84e4-a73e00de078a admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:00.128291 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b945e-f11e-47a1-84e4-a73e00de078a admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:00.128567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b945e-f11e-47a1-84e4-a73e00de078a admin admin] PATH_INFO: `/v3/projects/f3a1a0024e0441c99bfbba3067e367a8/users/e35df92a9bee40908b24d684612de3ca/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:00.146098 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b945e-f11e-47a1-84e4-a73e00de078a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a1a0024e0441c99bfbba3067e367a8, user_id=e35df92a9bee40908b24d684612de3ca, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:00.149054 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b945e-f11e-47a1-84e4-a73e00de078a admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:00.178716 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 798/1571] 10.222.0.43 () {60 vars in 1482 bytes} [Sun Jul 24 01:05:00 2022] PUT /identity/v3/projects/f3a1a0024e0441c99bfbba3067e367a8/users/e35df92a9bee40908b24d684612de3ca/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:05:00.182831 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7b0a6-8c4a-486b-8d3c-26b7a97721fb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:00.221404 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7b0a6-8c4a-486b-8d3c-26b7a97721fb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:00.339473 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef1aea-7e20-419b-9d96-a8f1e3e5f234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:00.340209 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1aea-7e20-419b-9d96-a8f1e3e5f234 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:00.340492 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1aea-7e20-419b-9d96-a8f1e3e5f234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:00.340898 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1aea-7e20-419b-9d96-a8f1e3e5f234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:00.341727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef1aea-7e20-419b-9d96-a8f1e3e5f234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:00.357624 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef1aea-7e20-419b-9d96-a8f1e3e5f234 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:00.373645 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 774/1572] 10.222.0.43 () {58 vars in 1121 bytes} [Sun Jul 24 01:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:05:00.377626 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b945e-f11e-47a1-84e4-a73e00de078a admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:00.383438 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:00.394424 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b945e-f11e-47a1-84e4-a73e00de078a admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:00.406734 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374f49b-c82e-4e45-b393-8a88707a3e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:00.414135 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374f49b-c82e-4e45-b393-8a88707a3e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:00.414668 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374f49b-c82e-4e45-b393-8a88707a3e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:00.414960 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374f49b-c82e-4e45-b393-8a88707a3e64 admin admin] PATH_INFO: `/v3/projects/f3a1a0024e0441c99bfbba3067e367a8/users/e35df92a9bee40908b24d684612de3ca/roles/463fec8fb3fb46febb7e7cc6952f61ad` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:00.417590 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374f49b-c82e-4e45-b393-8a88707a3e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a1a0024e0441c99bfbba3067e367a8, user_id=e35df92a9bee40908b24d684612de3ca, role_id=463fec8fb3fb46febb7e7cc6952f61ad)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:00.420455 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374f49b-c82e-4e45-b393-8a88707a3e64 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:00.437139 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 799/1573] 10.222.0.43 () {60 vars in 1482 bytes} [Sun Jul 24 01:05:00 2022] PUT /identity/v3/projects/f3a1a0024e0441c99bfbba3067e367a8/users/e35df92a9bee40908b24d684612de3ca/roles/463fec8fb3fb46febb7e7cc6952f61ad => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:05:06.421711 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80808fce-bd88-4544-8dd3-545e8b519776 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:06.422512 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80808fce-bd88-4544-8dd3-545e8b519776 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:06.422989 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80808fce-bd88-4544-8dd3-545e8b519776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:06.440080 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:06.459992 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-80808fce-bd88-4544-8dd3-545e8b519776 None None] MFA Rules not processed for user `bbde8079aa9c488a840b91b0e5fd0d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:06.462345 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-80808fce-bd88-4544-8dd3-545e8b519776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:06.582813 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374f49b-c82e-4e45-b393-8a88707a3e64 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:06.586253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-2374f49b-c82e-4e45-b393-8a88707a3e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:06.592510 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 775/1574] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:06.754122 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374f49b-c82e-4e45-b393-8a88707a3e64 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:06.758706 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0a8a9-675e-47a8-aac9-6aa368738de0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c366d0b41ee4632b6ba0c3bb11511f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:06.759615 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0a8a9-675e-47a8-aac9-6aa368738de0 service glance] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:06.759964 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0a8a9-675e-47a8-aac9-6aa368738de0 service glance] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:06.760364 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0a8a9-675e-47a8-aac9-6aa368738de0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:06.801304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752032f-091f-483e-935a-471cbb653faf None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:06.803494 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752032f-091f-483e-935a-471cbb653faf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:06.803990 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752032f-091f-483e-935a-471cbb653faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:06.840469 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0a8a9-675e-47a8-aac9-6aa368738de0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:06.842236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c752032f-091f-483e-935a-471cbb653faf None None] MFA Rules not processed for user `e35df92a9bee40908b24d684612de3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:06.843037 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0a8a9-675e-47a8-aac9-6aa368738de0 service glance] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:06.843478 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c752032f-091f-483e-935a-471cbb653faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:06.867426 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 800/1575] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:05:06.947340 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 776/1576] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:06.968780 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0a8a9-675e-47a8-aac9-6aa368738de0 service glance] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:06.978215 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0a8a9-675e-47a8-aac9-6aa368738de0 service glance] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:06.986709 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59541aaf-f5fd-4898-b9f4-392b91502266 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c366d0b41ee4632b6ba0c3bb11511f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:06.987576 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59541aaf-f5fd-4898-b9f4-392b91502266 service glance] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:06.987931 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59541aaf-f5fd-4898-b9f4-392b91502266 service glance] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:06.988268 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59541aaf-f5fd-4898-b9f4-392b91502266 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:07.079308 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59541aaf-f5fd-4898-b9f4-392b91502266 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:07.081585 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59541aaf-f5fd-4898-b9f4-392b91502266 service glance] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:07.097615 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 801/1577] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:05:07.285801 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda109eb-a61f-457a-92cd-3f3fb49d533d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:07.286470 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda109eb-a61f-457a-92cd-3f3fb49d533d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:07.287090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda109eb-a61f-457a-92cd-3f3fb49d533d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:07.359575 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-bda109eb-a61f-457a-92cd-3f3fb49d533d None None] MFA Rules not processed for user `8a465bdbfe3248679adc15154a152d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:07.361695 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bda109eb-a61f-457a-92cd-3f3fb49d533d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:07.437272 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=100 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:07.467267 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 777/1578] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Jul 24 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:07.570500 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59541aaf-f5fd-4898-b9f4-392b91502266 service glance] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:07.572403 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-59541aaf-f5fd-4898-b9f4-392b91502266 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:07.610744 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:07.684951 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59541aaf-f5fd-4898-b9f4-392b91502266 service glance] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:07.690692 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03578749-4d58-4364-8824-f2c2de7857f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd9e9ad3ecec40b9a3c88a5f2b8fdfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:07.691409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03578749-4d58-4364-8824-f2c2de7857f2 service swift] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:07.691693 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03578749-4d58-4364-8824-f2c2de7857f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:07.691969 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03578749-4d58-4364-8824-f2c2de7857f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:07.701939 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03578749-4d58-4364-8824-f2c2de7857f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:07.703556 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03578749-4d58-4364-8824-f2c2de7857f2 service swift] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:07.713196 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 802/1579] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Jul 24 01:05:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:05:08.497159 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09735-b178-4e62-8509-d94379f2e120 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:08.497636 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09735-b178-4e62-8509-d94379f2e120 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:08.497741 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09735-b178-4e62-8509-d94379f2e120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:08.541621 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3bd09735-b178-4e62-8509-d94379f2e120 None None] MFA Rules not processed for user `8a465bdbfe3248679adc15154a152d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:08.543953 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3bd09735-b178-4e62-8509-d94379f2e120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:08.569851 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 778/1580] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Jul 24 01:05:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:08.584536 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03578749-4d58-4364-8824-f2c2de7857f2 service swift] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:08.596770 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03578749-4d58-4364-8824-f2c2de7857f2 service swift] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:08.610131 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a606f-594f-40bd-99bd-773d8b2e795d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd9e9ad3ecec40b9a3c88a5f2b8fdfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:08.611127 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a606f-594f-40bd-99bd-773d8b2e795d service swift] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:08.612200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a606f-594f-40bd-99bd-773d8b2e795d service swift] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:08.612662 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a606f-594f-40bd-99bd-773d8b2e795d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:08.622529 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a606f-594f-40bd-99bd-773d8b2e795d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:08.624311 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a606f-594f-40bd-99bd-773d8b2e795d service swift] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:08.636606 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 803/1581] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Jul 24 01:05:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:05:17.554366 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f56983-c698-4650-963a-ba765e07d4f6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:17.555911 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f56983-c698-4650-963a-ba765e07d4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:17.556591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f56983-c698-4650-963a-ba765e07d4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:17.579116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b6f56983-c698-4650-963a-ba765e07d4f6 None None] MFA Rules not processed for user `8f892a8269184083b896a720ea87de05`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:17.580411 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b6f56983-c698-4650-963a-ba765e07d4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:17.593612 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 779/1582] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:05:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:17.889179 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777003e-73ac-4ee5-bde7-74e050a1dc0e None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:17.889820 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777003e-73ac-4ee5-bde7-74e050a1dc0e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:17.890085 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777003e-73ac-4ee5-bde7-74e050a1dc0e None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:17.891850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 804/1583] 10.222.0.43 () {54 vars in 962 bytes} [Sun Jul 24 01:05:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:17.897814 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3a0be-07c8-4865-9067-13d6df416178 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:17.898218 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3a0be-07c8-4865-9067-13d6df416178 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:17.898558 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3a0be-07c8-4865-9067-13d6df416178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:17.940150 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-53f3a0be-07c8-4865-9067-13d6df416178 None None] MFA Rules not processed for user `808b08d1d2df42e587279071a5dba593`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:17.941585 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-53f3a0be-07c8-4865-9067-13d6df416178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:18.018049 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 780/1584] 10.222.0.43 () {58 vars in 1059 bytes} [Sun Jul 24 01:05:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:18.023679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47093702-bc74-4890-9560-6789fd9b0d83 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:18.024229 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47093702-bc74-4890-9560-6789fd9b0d83 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:18.024646 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47093702-bc74-4890-9560-6789fd9b0d83 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:18.026662 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 805/1585] 10.222.0.43 () {54 vars in 912 bytes} [Sun Jul 24 01:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:18.032210 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea4e52-e386-40a0-a7f4-f980a90b5eec None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:18.032626 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea4e52-e386-40a0-a7f4-f980a90b5eec None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:18.032994 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea4e52-e386-40a0-a7f4-f980a90b5eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:18.051918 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8fea4e52-e386-40a0-a7f4-f980a90b5eec None None] MFA Rules not processed for user `808b08d1d2df42e587279071a5dba593`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:18.053431 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8fea4e52-e386-40a0-a7f4-f980a90b5eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:18.076738 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 781/1586] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Jul 24 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:05:18.091380 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47093702-bc74-4890-9560-6789fd9b0d83 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:18.103453 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47093702-bc74-4890-9560-6789fd9b0d83 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:18.107407 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026d449-a823-48cc-b9ae-37a1175c6908 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c366d0b41ee4632b6ba0c3bb11511f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:18.108470 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026d449-a823-48cc-b9ae-37a1175c6908 service glance] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:18.109340 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026d449-a823-48cc-b9ae-37a1175c6908 service glance] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:18.109624 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026d449-a823-48cc-b9ae-37a1175c6908 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:18.123604 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026d449-a823-48cc-b9ae-37a1175c6908 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:18.125088 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026d449-a823-48cc-b9ae-37a1175c6908 service glance] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:18.136202 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 806/1587] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:18.519284 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97d3cd-7ad6-4bb0-b4fe-0183783645b7 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:18.519614 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97d3cd-7ad6-4bb0-b4fe-0183783645b7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:18.519889 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97d3cd-7ad6-4bb0-b4fe-0183783645b7 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:18.521290 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 782/1588] 10.222.0.43 () {54 vars in 912 bytes} [Sun Jul 24 01:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:18.526756 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8c2ef-291e-4750-92d1-bbbc15c9da39 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:18.531475 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8c2ef-291e-4750-92d1-bbbc15c9da39 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:18.531824 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8c2ef-291e-4750-92d1-bbbc15c9da39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:18.579110 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-8dc8c2ef-291e-4750-92d1-bbbc15c9da39 None None] MFA Rules not processed for user `e0dae91953bf4a84883723bf3639e377`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:18.580346 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8dc8c2ef-291e-4750-92d1-bbbc15c9da39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:18.647567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 807/1589] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Jul 24 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:18.659023 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97d3cd-7ad6-4bb0-b4fe-0183783645b7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:18.660704 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4c97d3cd-7ad6-4bb0-b4fe-0183783645b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:18.674821 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97d3cd-7ad6-4bb0-b4fe-0183783645b7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:18.678949 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3052a-35d4-453d-a729-5a3902781426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:18.679755 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3052a-35d4-453d-a729-5a3902781426 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:18.680044 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3052a-35d4-453d-a729-5a3902781426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:18.680320 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3052a-35d4-453d-a729-5a3902781426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:18.699034 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3052a-35d4-453d-a729-5a3902781426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:18.700779 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3052a-35d4-453d-a729-5a3902781426 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:18.711698 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 783/1590] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:19.139058 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b05e1-5f40-466b-93a9-9059ffe68c45 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:19.139518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b05e1-5f40-466b-93a9-9059ffe68c45 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:19.139611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b05e1-5f40-466b-93a9-9059ffe68c45 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:19.140986 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 808/1591] 10.222.0.43 () {54 vars in 962 bytes} [Sun Jul 24 01:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:19.143089 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53783a2e-d8a4-4a2b-a50b-117399ea8017 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:19.143380 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53783a2e-d8a4-4a2b-a50b-117399ea8017 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:19.143660 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53783a2e-d8a4-4a2b-a50b-117399ea8017 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:19.145038 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 784/1592] 10.222.0.43 () {54 vars in 961 bytes} [Sun Jul 24 01:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:19.147896 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32decc16-eeab-4c46-8813-a27cae6fe17a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:19.148184 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32decc16-eeab-4c46-8813-a27cae6fe17a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:19.148474 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32decc16-eeab-4c46-8813-a27cae6fe17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:19.150015 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe2dd3-cc32-4cbd-8b5c-f3f612d91ef6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:19.150301 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe2dd3-cc32-4cbd-8b5c-f3f612d91ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:19.150579 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe2dd3-cc32-4cbd-8b5c-f3f612d91ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:19.167190 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-32decc16-eeab-4c46-8813-a27cae6fe17a None None] MFA Rules not processed for user `808b08d1d2df42e587279071a5dba593`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:19.168711 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-32decc16-eeab-4c46-8813-a27cae6fe17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:19.169390 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-25fe2dd3-cc32-4cbd-8b5c-f3f612d91ef6 None None] MFA Rules not processed for user `cce671a84420484580cfd8efe6a6e227`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:19.170571 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-25fe2dd3-cc32-4cbd-8b5c-f3f612d91ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:19.178376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 809/1593] 10.222.0.43 () {58 vars in 1059 bytes} [Sun Jul 24 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:19.184161 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eb86e-06ad-451a-8927-837fb46ac7df None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:19.184574 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eb86e-06ad-451a-8927-837fb46ac7df None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:19.184859 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eb86e-06ad-451a-8927-837fb46ac7df None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:19.186275 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 810/1594] 10.222.0.43 () {54 vars in 912 bytes} [Sun Jul 24 01:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:05:19.190935 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc1f99-1788-4746-b00a-bd4bf812f869 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:19.191223 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc1f99-1788-4746-b00a-bd4bf812f869 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:19.191532 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc1f99-1788-4746-b00a-bd4bf812f869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:19.211284 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-acfc1f99-1788-4746-b00a-bd4bf812f869 None None] MFA Rules not processed for user `808b08d1d2df42e587279071a5dba593`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:19.213063 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-acfc1f99-1788-4746-b00a-bd4bf812f869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:19.223442 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 811/1595] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Jul 24 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:05:19.235312 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc1f99-1788-4746-b00a-bd4bf812f869 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:19.236783 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 785/1596] 10.222.0.43 () {58 vars in 1058 bytes} [Sun Jul 24 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:05:19.244328 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe2dd3-cc32-4cbd-8b5c-f3f612d91ef6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:19.244513 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc1f99-1788-4746-b00a-bd4bf812f869 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:19.247923 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c4f6c-96be-4e92-b470-d13bf760496b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:19.248569 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c4f6c-96be-4e92-b470-d13bf760496b service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:19.248849 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c4f6c-96be-4e92-b470-d13bf760496b service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:19.249130 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c4f6c-96be-4e92-b470-d13bf760496b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:19.254048 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe2dd3-cc32-4cbd-8b5c-f3f612d91ef6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:19.258899 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb0487-56ba-4432-be55-a8cd8e06ebe0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce671a84420484580cfd8efe6a6e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:19.259379 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c4f6c-96be-4e92-b470-d13bf760496b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:19.259527 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb0487-56ba-4432-be55-a8cd8e06ebe0 service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:19.259803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb0487-56ba-4432-be55-a8cd8e06ebe0 service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:19.260070 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb0487-56ba-4432-be55-a8cd8e06ebe0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:19.260895 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c4f6c-96be-4e92-b470-d13bf760496b service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:19.262006 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-dcfb0487-56ba-4432-be55-a8cd8e06ebe0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:19.271898 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 812/1597] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:05:19.276445 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb0487-56ba-4432-be55-a8cd8e06ebe0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:19.278090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb0487-56ba-4432-be55-a8cd8e06ebe0 service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:19.287963 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 786/1598] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:05:21.130011 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5a0d9-e7c2-459e-a99c-043d8c9c228a None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:21.130497 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5a0d9-e7c2-459e-a99c-043d8c9c228a None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:21.130626 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5a0d9-e7c2-459e-a99c-043d8c9c228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:21.148899 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-b9a5a0d9-e7c2-459e-a99c-043d8c9c228a None None] MFA Rules not processed for user `8a465bdbfe3248679adc15154a152d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:21.150167 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b9a5a0d9-e7c2-459e-a99c-043d8c9c228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:21.157601 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 813/1599] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Jul 24 01:05:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:21.170817 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb0487-56ba-4432-be55-a8cd8e06ebe0 service placement] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:21.182384 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb0487-56ba-4432-be55-a8cd8e06ebe0 service placement] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:21.187904 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a0c35-fe5f-400b-aaff-9923c030c0a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd9e9ad3ecec40b9a3c88a5f2b8fdfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:21.188590 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a0c35-fe5f-400b-aaff-9923c030c0a2 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:21.188849 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a0c35-fe5f-400b-aaff-9923c030c0a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:21.189701 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a0c35-fe5f-400b-aaff-9923c030c0a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:21.198893 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a0c35-fe5f-400b-aaff-9923c030c0a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:21.200514 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a0c35-fe5f-400b-aaff-9923c030c0a2 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:21.209441 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 787/1600] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Jul 24 01:05:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:05:31.143572 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=87 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:31.205752 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=98 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:36.633090 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc22aa3-74bb-43ea-a685-82aa67629a17 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:36.633623 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc22aa3-74bb-43ea-a685-82aa67629a17 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:36.633717 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc22aa3-74bb-43ea-a685-82aa67629a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:36.653102 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4dc22aa3-74bb-43ea-a685-82aa67629a17 None None] MFA Rules not processed for user `e0dae91953bf4a84883723bf3639e377`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:36.654433 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4dc22aa3-74bb-43ea-a685-82aa67629a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:36.662057 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 814/1601] 10.222.0.48 () {58 vars in 1015 bytes} [Sun Jul 24 01:05:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:36.675542 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a0c35-fe5f-400b-aaff-9923c030c0a2 service swift] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:36.685590 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a0c35-fe5f-400b-aaff-9923c030c0a2 service swift] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:36.690217 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa75af-c6b6-429b-887f-557a2d483d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:36.690842 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa75af-c6b6-429b-887f-557a2d483d1d service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:36.691118 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa75af-c6b6-429b-887f-557a2d483d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:36.691372 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa75af-c6b6-429b-887f-557a2d483d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:36.698866 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa75af-c6b6-429b-887f-557a2d483d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:36.700343 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa75af-c6b6-429b-887f-557a2d483d1d service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:36.708342 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 788/1602] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:37.677232 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637a1c6-9eab-4837-933e-d1db7a93f993 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:37.677822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637a1c6-9eab-4837-933e-d1db7a93f993 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:37.677822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637a1c6-9eab-4837-933e-d1db7a93f993 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:37.679255 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 815/1603] 10.222.0.43 () {54 vars in 921 bytes} [Sun Jul 24 01:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:37.692236 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81097f-6ff3-4e76-8d62-075b04cc7b5e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:37.692858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81097f-6ff3-4e76-8d62-075b04cc7b5e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:37.692858 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81097f-6ff3-4e76-8d62-075b04cc7b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:37.720688 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-bb81097f-6ff3-4e76-8d62-075b04cc7b5e None None] MFA Rules not processed for user `808b08d1d2df42e587279071a5dba593`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:37.721975 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bb81097f-6ff3-4e76-8d62-075b04cc7b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:37.734072 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 789/1604] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Jul 24 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:37.777582 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637a1c6-9eab-4837-933e-d1db7a93f993 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:37.792937 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637a1c6-9eab-4837-933e-d1db7a93f993 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:37.798617 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9c8f9-c552-4f93-bbe9-3470ac98b3b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:37.799484 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9c8f9-c552-4f93-bbe9-3470ac98b3b5 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:37.799960 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9c8f9-c552-4f93-bbe9-3470ac98b3b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:37.800492 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9c8f9-c552-4f93-bbe9-3470ac98b3b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:37.810111 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9c8f9-c552-4f93-bbe9-3470ac98b3b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:37.811743 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9c8f9-c552-4f93-bbe9-3470ac98b3b5 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:37.821940 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 816/1605] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:44.994661 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99479901-8845-4a3e-a971-eb20200c0085 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:44.995259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99479901-8845-4a3e-a971-eb20200c0085 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:44.995259 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99479901-8845-4a3e-a971-eb20200c0085 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:44.997841 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 790/1606] 10.222.0.43 () {54 vars in 921 bytes} [Sun Jul 24 01:05:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:45.007901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ee34-6150-4bd1-9636-bf29f3580a67 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:45.008439 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ee34-6150-4bd1-9636-bf29f3580a67 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:45.008439 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ee34-6150-4bd1-9636-bf29f3580a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:45.029658 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-91f8ee34-6150-4bd1-9636-bf29f3580a67 None None] MFA Rules not processed for user `808b08d1d2df42e587279071a5dba593`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:45.030952 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-91f8ee34-6150-4bd1-9636-bf29f3580a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:45.041118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 817/1607] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Jul 24 01:05:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:45.056091 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99479901-8845-4a3e-a971-eb20200c0085 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:45.072082 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99479901-8845-4a3e-a971-eb20200c0085 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:45.078110 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5801fc3-b7f2-4a23-a5cb-08a2e09ddb06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:45.078970 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5801fc3-b7f2-4a23-a5cb-08a2e09ddb06 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:45.079064 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5801fc3-b7f2-4a23-a5cb-08a2e09ddb06 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:45.079326 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5801fc3-b7f2-4a23-a5cb-08a2e09ddb06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:45.089111 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5801fc3-b7f2-4a23-a5cb-08a2e09ddb06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:45.090735 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5801fc3-b7f2-4a23-a5cb-08a2e09ddb06 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:45.101485 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 791/1608] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:55.024285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=12 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:55.097175 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=15 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:05.524118 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290edeab-016d-413e-abcb-1a2cfd9a1158 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:05.524667 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290edeab-016d-413e-abcb-1a2cfd9a1158 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:05.524667 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290edeab-016d-413e-abcb-1a2cfd9a1158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:05.542928 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-290edeab-016d-413e-abcb-1a2cfd9a1158 None None] MFA Rules not processed for user `f31c423447a74d4d9411e20528726579`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:06:05.544138 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-290edeab-016d-413e-abcb-1a2cfd9a1158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:05.551317 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 818/1609] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:06:10.700248 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5801fc3-b7f2-4a23-a5cb-08a2e09ddb06 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:10.713563 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5801fc3-b7f2-4a23-a5cb-08a2e09ddb06 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:10.718140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67bc80-255e-408a-8648-aa46bc0fb6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:10.719455 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67bc80-255e-408a-8648-aa46bc0fb6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:10.719939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67bc80-255e-408a-8648-aa46bc0fb6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:10.720434 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67bc80-255e-408a-8648-aa46bc0fb6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:10.737124 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67bc80-255e-408a-8648-aa46bc0fb6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:10.738644 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67bc80-255e-408a-8648-aa46bc0fb6b4 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:10.750341 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 792/1610] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:06:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:12.176946 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd9c8a-8693-45eb-88ea-b16651598270 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:12.177588 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd9c8a-8693-45eb-88ea-b16651598270 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:12.177588 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd9c8a-8693-45eb-88ea-b16651598270 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:12.179172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 819/1611] 10.222.0.43 () {54 vars in 921 bytes} [Sun Jul 24 01:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:06:12.215279 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1b25c-18e5-4e9c-b546-63094e845c81 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:12.215907 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1b25c-18e5-4e9c-b546-63094e845c81 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:12.215907 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1b25c-18e5-4e9c-b546-63094e845c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:12.238717 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5ad1b25c-18e5-4e9c-b546-63094e845c81 None None] MFA Rules not processed for user `808b08d1d2df42e587279071a5dba593`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:06:12.240280 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5ad1b25c-18e5-4e9c-b546-63094e845c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:12.254183 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 793/1612] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Jul 24 01:06:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:06:12.392726 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd9c8a-8693-45eb-88ea-b16651598270 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:12.409197 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd9c8a-8693-45eb-88ea-b16651598270 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:12.416200 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219ca3e-bd93-4e62-bde6-42d1099b86b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:12.417354 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219ca3e-bd93-4e62-bde6-42d1099b86b6 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:12.417703 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219ca3e-bd93-4e62-bde6-42d1099b86b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:12.418143 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219ca3e-bd93-4e62-bde6-42d1099b86b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:12.429397 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219ca3e-bd93-4e62-bde6-42d1099b86b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:12.431165 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219ca3e-bd93-4e62-bde6-42d1099b86b6 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:12.443335 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 820/1613] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:06:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:22.230253 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=9 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:22.438550 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=9 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:03.660803 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5acda9-4bb4-4e3d-9bb4-e2401b483f5f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:03.661686 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5acda9-4bb4-4e3d-9bb4-e2401b483f5f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:03.661686 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5acda9-4bb4-4e3d-9bb4-e2401b483f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:03.685620 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7e5acda9-4bb4-4e3d-9bb4-e2401b483f5f None None] MFA Rules not processed for user `f31c423447a74d4d9411e20528726579`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:07:03.686806 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7e5acda9-4bb4-4e3d-9bb4-e2401b483f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:03.694882 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 794/1614] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:07:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:07:03.979952 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b41ff8-3319-47ad-9f4d-b578d8707335 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:03.980505 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b41ff8-3319-47ad-9f4d-b578d8707335 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:03.980505 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b41ff8-3319-47ad-9f4d-b578d8707335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:04.001029 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c2b41ff8-3319-47ad-9f4d-b578d8707335 None None] MFA Rules not processed for user `e0dae91953bf4a84883723bf3639e377`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:07:04.002282 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c2b41ff8-3319-47ad-9f4d-b578d8707335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:04.010253 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 821/1615] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Jul 24 01:07:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:07:04.024544 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5acda9-4bb4-4e3d-9bb4-e2401b483f5f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:07:04.035286 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5acda9-4bb4-4e3d-9bb4-e2401b483f5f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:07:04.039395 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b5d26-2a0e-4b33-bbe1-c664d6f702b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:07:04.040099 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b5d26-2a0e-4b33-bbe1-c664d6f702b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:04.040376 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b5d26-2a0e-4b33-bbe1-c664d6f702b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:04.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b5d26-2a0e-4b33-bbe1-c664d6f702b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:04.047857 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b5d26-2a0e-4b33-bbe1-c664d6f702b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:07:04.049341 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b5d26-2a0e-4b33-bbe1-c664d6f702b4 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:07:04.057182 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 795/1616] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:07:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:07:13.995330 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=3 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:14.053894 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=9 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:23.186007 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86514f93-d030-4aeb-8007-76fd2eb08e97 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:23.186498 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86514f93-d030-4aeb-8007-76fd2eb08e97 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:23.186590 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86514f93-d030-4aeb-8007-76fd2eb08e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:23.205499 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-86514f93-d030-4aeb-8007-76fd2eb08e97 None None] MFA Rules not processed for user `8a465bdbfe3248679adc15154a152d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:07:23.206700 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-86514f93-d030-4aeb-8007-76fd2eb08e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:23.215561 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 822/1617] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Jul 24 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:07:23.256815 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b5d26-2a0e-4b33-bbe1-c664d6f702b4 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:07:23.269140 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b5d26-2a0e-4b33-bbe1-c664d6f702b4 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:07:23.274288 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e283678-f732-4f48-b7d0-85fd7f55e47a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd9e9ad3ecec40b9a3c88a5f2b8fdfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:07:23.274994 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e283678-f732-4f48-b7d0-85fd7f55e47a service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:23.275209 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e283678-f732-4f48-b7d0-85fd7f55e47a service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:23.275482 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e283678-f732-4f48-b7d0-85fd7f55e47a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:23.283586 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e283678-f732-4f48-b7d0-85fd7f55e47a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:07:23.285179 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e283678-f732-4f48-b7d0-85fd7f55e47a service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:07:23.293300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 796/1618] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Jul 24 01:07:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:07:28.707053 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476782f-e528-4984-b19e-ba71549b4f84 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:28.707544 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476782f-e528-4984-b19e-ba71549b4f84 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:28.707641 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476782f-e528-4984-b19e-ba71549b4f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:28.727517 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-c476782f-e528-4984-b19e-ba71549b4f84 None None] MFA Rules not processed for user `f31c423447a74d4d9411e20528726579`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:07:28.728707 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-c476782f-e528-4984-b19e-ba71549b4f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:28.736226 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 823/1619] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:07:33.291000 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=6 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:38.721600 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=6 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:00.810520 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dd94c-8399-4105-8902-52f73d416647 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:00.811028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dd94c-8399-4105-8902-52f73d416647 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:00.811123 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dd94c-8399-4105-8902-52f73d416647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:00.830835 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3a1dd94c-8399-4105-8902-52f73d416647 None None] MFA Rules not processed for user `8a465bdbfe3248679adc15154a152d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:00.839597 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3a1dd94c-8399-4105-8902-52f73d416647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:00.848104 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 797/1620] 10.222.0.43 () {58 vars in 967 bytes} [Sun Jul 24 01:08:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:00.860988 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476782f-e528-4984-b19e-ba71549b4f84 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:00.874284 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476782f-e528-4984-b19e-ba71549b4f84 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:00.880029 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fedd8c-4219-4938-b0c8-510e71d095bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd9e9ad3ecec40b9a3c88a5f2b8fdfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:00.880679 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fedd8c-4219-4938-b0c8-510e71d095bc service swift] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:00.880964 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fedd8c-4219-4938-b0c8-510e71d095bc service swift] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:00.881269 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fedd8c-4219-4938-b0c8-510e71d095bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:00.889711 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fedd8c-4219-4938-b0c8-510e71d095bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:00.891298 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fedd8c-4219-4938-b0c8-510e71d095bc service swift] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:00.899423 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 824/1621] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Jul 24 01:08:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:08:10.825304 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=3 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:10.896325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=6 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:27.061422 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aba1d-582d-448b-a998-2fe1234e7da3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:27.061937 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aba1d-582d-448b-a998-2fe1234e7da3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:27.062028 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aba1d-582d-448b-a998-2fe1234e7da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:27.083518 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7d3aba1d-582d-448b-a998-2fe1234e7da3 None None] MFA Rules not processed for user `f31c423447a74d4d9411e20528726579`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:27.086350 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7d3aba1d-582d-448b-a998-2fe1234e7da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:27.093692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 798/1622] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:08:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:28.349190 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fedd8c-4219-4938-b0c8-510e71d095bc service swift] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:28.361125 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fedd8c-4219-4938-b0c8-510e71d095bc service swift] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:28.367515 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b33d1-3018-4521-8ef6-6c51e894b934 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce671a84420484580cfd8efe6a6e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:28.368179 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b33d1-3018-4521-8ef6-6c51e894b934 service placement] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:28.368461 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b33d1-3018-4521-8ef6-6c51e894b934 service placement] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:28.368718 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b33d1-3018-4521-8ef6-6c51e894b934 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:28.377888 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b33d1-3018-4521-8ef6-6c51e894b934 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:28.379518 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b33d1-3018-4521-8ef6-6c51e894b934 service placement] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:28.391556 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 825/1623] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:37.077956 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=3 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:38.387748 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=6 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:44.648275 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aba1d-582d-448b-a998-2fe1234e7da3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:44.659942 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aba1d-582d-448b-a998-2fe1234e7da3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:44.665321 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f911d-9c28-4caf-8076-e6015d96dd6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:44.665978 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f911d-9c28-4caf-8076-e6015d96dd6f service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:44.666256 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f911d-9c28-4caf-8076-e6015d96dd6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:44.666520 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f911d-9c28-4caf-8076-e6015d96dd6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:44.678220 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f911d-9c28-4caf-8076-e6015d96dd6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:44.679653 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f911d-9c28-4caf-8076-e6015d96dd6f service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:44.693237 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 799/1624] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:54.685562 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=6 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:31.314157 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b33d1-3018-4521-8ef6-6c51e894b934 service placement] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:31.329376 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b33d1-3018-4521-8ef6-6c51e894b934 service placement] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:31.336563 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d16ec-d87a-4247-8945-433e0f4e3fb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:31.337527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d16ec-d87a-4247-8945-433e0f4e3fb1 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:31.337855 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d16ec-d87a-4247-8945-433e0f4e3fb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:31.338250 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d16ec-d87a-4247-8945-433e0f4e3fb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:31.346684 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d16ec-d87a-4247-8945-433e0f4e3fb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:31.348261 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d16ec-d87a-4247-8945-433e0f4e3fb1 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:31.357312 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 826/1625] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:31.403926 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f911d-9c28-4caf-8076-e6015d96dd6f service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:31.412654 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f911d-9c28-4caf-8076-e6015d96dd6f service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:31.417146 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cec89-1d3a-4847-aebe-bb6cc537ecbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:31.417816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cec89-1d3a-4847-aebe-bb6cc537ecbf service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:31.418102 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cec89-1d3a-4847-aebe-bb6cc537ecbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:31.418374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cec89-1d3a-4847-aebe-bb6cc537ecbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:31.429109 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cec89-1d3a-4847-aebe-bb6cc537ecbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:31.430589 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cec89-1d3a-4847-aebe-bb6cc537ecbf service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:31.441463 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 800/1626] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:36.120978 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d16ec-d87a-4247-8945-433e0f4e3fb1 service nova] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:36.181864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d16ec-d87a-4247-8945-433e0f4e3fb1 service nova] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:36.185884 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe45c4-6463-4198-ba15-7d623fc88d71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c87c6bb14d74884a8c4ff8915d2494e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:36.186527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe45c4-6463-4198-ba15-7d623fc88d71 service cinder] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:36.186804 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe45c4-6463-4198-ba15-7d623fc88d71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:36.187072 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe45c4-6463-4198-ba15-7d623fc88d71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:36.197635 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe45c4-6463-4198-ba15-7d623fc88d71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:36.199185 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe45c4-6463-4198-ba15-7d623fc88d71 service cinder] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:36.209854 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 827/1627] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:40.200674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cec89-1d3a-4847-aebe-bb6cc537ecbf service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:40.213192 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cec89-1d3a-4847-aebe-bb6cc537ecbf service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:40.220877 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4f192-31b9-4113-bae8-381573eea002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:40.221561 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4f192-31b9-4113-bae8-381573eea002 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:40.221842 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4f192-31b9-4113-bae8-381573eea002 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:40.222114 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4f192-31b9-4113-bae8-381573eea002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:40.235094 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4f192-31b9-4113-bae8-381573eea002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:40.236700 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4f192-31b9-4113-bae8-381573eea002 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:40.247040 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 801/1628] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:41.240850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0465e2-d21f-4dcf-8891-ae626778651e None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:41.241318 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0465e2-d21f-4dcf-8891-ae626778651e None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:41.241441 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0465e2-d21f-4dcf-8891-ae626778651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:41.259055 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-0c0465e2-d21f-4dcf-8891-ae626778651e None None] MFA Rules not processed for user `8a465bdbfe3248679adc15154a152d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:41.260287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-0c0465e2-d21f-4dcf-8891-ae626778651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:41.268467 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 828/1629] 10.222.0.43 () {58 vars in 967 bytes} [Sun Jul 24 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:41.320552 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4f192-31b9-4113-bae8-381573eea002 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:41.332900 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4f192-31b9-4113-bae8-381573eea002 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:41.339070 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88c180-dddd-46fe-ab8f-4decf5a49183 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd9e9ad3ecec40b9a3c88a5f2b8fdfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:41.339719 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88c180-dddd-46fe-ab8f-4decf5a49183 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:41.340053 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88c180-dddd-46fe-ab8f-4decf5a49183 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:41.340319 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88c180-dddd-46fe-ab8f-4decf5a49183 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:41.349110 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88c180-dddd-46fe-ab8f-4decf5a49183 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:41.350721 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88c180-dddd-46fe-ab8f-4decf5a49183 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:41.359186 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 802/1630] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Jul 24 01:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:41.827829 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826cceb-5b43-4c89-ac5c-acbdfceaa13c None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:41.828135 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826cceb-5b43-4c89-ac5c-acbdfceaa13c None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:41.828409 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826cceb-5b43-4c89-ac5c-acbdfceaa13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:41.847605 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-4826cceb-5b43-4c89-ac5c-acbdfceaa13c None None] MFA Rules not processed for user `8a465bdbfe3248679adc15154a152d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:41.848801 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-4826cceb-5b43-4c89-ac5c-acbdfceaa13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:41.856772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 829/1631] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Jul 24 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:41.869401 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88c180-dddd-46fe-ab8f-4decf5a49183 service swift] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:41.880719 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88c180-dddd-46fe-ab8f-4decf5a49183 service swift] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:41.886698 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757263f-02f8-4871-af1d-c731df9578f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd9e9ad3ecec40b9a3c88a5f2b8fdfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:41.887350 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757263f-02f8-4871-af1d-c731df9578f1 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:41.887638 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757263f-02f8-4871-af1d-c731df9578f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:41.887903 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757263f-02f8-4871-af1d-c731df9578f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:41.896725 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757263f-02f8-4871-af1d-c731df9578f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:41.898823 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757263f-02f8-4871-af1d-c731df9578f1 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:41.909933 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 803/1632] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Jul 24 01:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:50.072000 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ac295-0e50-47db-975e-cb040c56f53d None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:50.072505 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ac295-0e50-47db-975e-cb040c56f53d None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:50.072614 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ac295-0e50-47db-975e-cb040c56f53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:50.090251 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-9c6ac295-0e50-47db-975e-cb040c56f53d None None] MFA Rules not processed for user `8f892a8269184083b896a720ea87de05`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:50.091446 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-9c6ac295-0e50-47db-975e-cb040c56f53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:50.098958 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 830/1633] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:50.689067 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757263f-02f8-4871-af1d-c731df9578f1 service swift] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:50.700452 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757263f-02f8-4871-af1d-c731df9578f1 service swift] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:50.710500 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20446d40-98e0-4488-8de3-5178fc44c7ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce671a84420484580cfd8efe6a6e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:50.711095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20446d40-98e0-4488-8de3-5178fc44c7ea service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:50.711375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20446d40-98e0-4488-8de3-5178fc44c7ea service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:50.711640 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20446d40-98e0-4488-8de3-5178fc44c7ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:50.724599 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20446d40-98e0-4488-8de3-5178fc44c7ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:50.726207 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20446d40-98e0-4488-8de3-5178fc44c7ea service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:50.736660 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 804/1634] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:52.026544 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15e8ad-f134-4fc4-9e4c-15e672a995c2 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:52.027074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15e8ad-f134-4fc4-9e4c-15e672a995c2 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:52.027074 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15e8ad-f134-4fc4-9e4c-15e672a995c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:52.046943 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-8d15e8ad-f134-4fc4-9e4c-15e672a995c2 None None] MFA Rules not processed for user `8a465bdbfe3248679adc15154a152d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:52.048284 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-8d15e8ad-f134-4fc4-9e4c-15e672a995c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:52.055967 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 831/1635] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Jul 24 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:52.068830 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20446d40-98e0-4488-8de3-5178fc44c7ea service placement] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:52.080124 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20446d40-98e0-4488-8de3-5178fc44c7ea service placement] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:52.085228 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e393a84-7b26-4f32-897a-d00feec8c648 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd9e9ad3ecec40b9a3c88a5f2b8fdfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:52.085884 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e393a84-7b26-4f32-897a-d00feec8c648 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:52.086168 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e393a84-7b26-4f32-897a-d00feec8c648 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:52.086443 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e393a84-7b26-4f32-897a-d00feec8c648 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:52.095215 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e393a84-7b26-4f32-897a-d00feec8c648 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:52.096834 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e393a84-7b26-4f32-897a-d00feec8c648 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:52.105131 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 805/1636] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Jul 24 01:10:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:11:00.833456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15e8ad-f134-4fc4-9e4c-15e672a995c2 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:00.843818 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=45 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:00.850755 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15e8ad-f134-4fc4-9e4c-15e672a995c2 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:00.857630 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0e5bb-3708-4cb3-b07d-a0ba7b449a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:00.858288 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0e5bb-3708-4cb3-b07d-a0ba7b449a97 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:00.858605 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0e5bb-3708-4cb3-b07d-a0ba7b449a97 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:00.858883 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0e5bb-3708-4cb3-b07d-a0ba7b449a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:00.867676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0e5bb-3708-4cb3-b07d-a0ba7b449a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:00.869402 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0e5bb-3708-4cb3-b07d-a0ba7b449a97 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:00.880154 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 832/1637] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:11:02.102224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=36 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:02.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e393a84-7b26-4f32-897a-d00feec8c648 service swift] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:02.847750 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e393a84-7b26-4f32-897a-d00feec8c648 service swift] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:02.851608 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e68b5-2815-42fa-ba15-565ad75421e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:02.852257 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e68b5-2815-42fa-ba15-565ad75421e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:02.852541 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e68b5-2815-42fa-ba15-565ad75421e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:02.852816 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e68b5-2815-42fa-ba15-565ad75421e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:02.860050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e68b5-2815-42fa-ba15-565ad75421e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:02.861527 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e68b5-2815-42fa-ba15-565ad75421e1 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:02.869628 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 806/1638] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:08.106372 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f9408-79f9-48f8-80c0-8bffd178b430 None None] REQUEST_METHOD: `POST` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:08.106870 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f9408-79f9-48f8-80c0-8bffd178b430 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:08.106962 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f9408-79f9-48f8-80c0-8bffd178b430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:08.125711 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.auth.core [None req-d43f9408-79f9-48f8-80c0-8bffd178b430 None None] MFA Rules not processed for user `f31c423447a74d4d9411e20528726579`. Rule list: `[]` (Enabled: `True`). {{(pid=80201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:08.126930 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-d43f9408-79f9-48f8-80c0-8bffd178b430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:08.135002 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 833/1639] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:08.473607 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e68b5-2815-42fa-ba15-565ad75421e1 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:08.482781 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e68b5-2815-42fa-ba15-565ad75421e1 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:08.487479 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429498-9b63-472a-a4ad-c6849370243c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:08.488129 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429498-9b63-472a-a4ad-c6849370243c service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:08.488415 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429498-9b63-472a-a4ad-c6849370243c service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:08.488684 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429498-9b63-472a-a4ad-c6849370243c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:08.496790 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4429498-9b63-472a-a4ad-c6849370243c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:08.498309 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4429498-9b63-472a-a4ad-c6849370243c service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:08.506871 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 807/1640] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:10.874266 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f9408-79f9-48f8-80c0-8bffd178b430 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:10.888914 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f9408-79f9-48f8-80c0-8bffd178b430 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:10.894332 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45e3c8-9f1a-45bc-be53-fb47fd054ddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:10.894995 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45e3c8-9f1a-45bc-be53-fb47fd054ddf service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:10.895277 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45e3c8-9f1a-45bc-be53-fb47fd054ddf service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:10.895575 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45e3c8-9f1a-45bc-be53-fb47fd054ddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:10.904931 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45e3c8-9f1a-45bc-be53-fb47fd054ddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:10.906838 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45e3c8-9f1a-45bc-be53-fb47fd054ddf service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:10.928325 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 834/1641] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:18.503300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=12 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:20.913676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=14 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:23.850009 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429498-9b63-472a-a4ad-c6849370243c service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:23.859199 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429498-9b63-472a-a4ad-c6849370243c service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:23.863219 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4866ee-0437-4df3-b509-1608d98ac8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:23.863918 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4866ee-0437-4df3-b509-1608d98ac8cc service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:23.864206 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4866ee-0437-4df3-b509-1608d98ac8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:23.864481 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4866ee-0437-4df3-b509-1608d98ac8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:23.874116 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4866ee-0437-4df3-b509-1608d98ac8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:23.875600 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4866ee-0437-4df3-b509-1608d98ac8cc service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:23.885666 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 808/1642] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:25.749480 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45e3c8-9f1a-45bc-be53-fb47fd054ddf service nova] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:25.761308 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45e3c8-9f1a-45bc-be53-fb47fd054ddf service nova] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:25.768373 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd86d1-e444-41a5-9354-aae4256d29f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:25.769097 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd86d1-e444-41a5-9354-aae4256d29f0 service nova] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:25.769389 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd86d1-e444-41a5-9354-aae4256d29f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:25.769698 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd86d1-e444-41a5-9354-aae4256d29f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:25.780445 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd86d1-e444-41a5-9354-aae4256d29f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:25.782077 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd86d1-e444-41a5-9354-aae4256d29f0 service nova] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:25.793259 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 835/1643] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:33.881422 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=6 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:35.788977 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=6 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:30.052910 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16939cf1-31e0-4261-871d-d93082221967 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:30.053543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16939cf1-31e0-4261-871d-d93082221967 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:30.053543 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16939cf1-31e0-4261-871d-d93082221967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:30.082001 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-16939cf1-31e0-4261-871d-d93082221967 None None] MFA Rules not processed for user `f31c423447a74d4d9411e20528726579`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:30.083177 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-16939cf1-31e0-4261-871d-d93082221967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:30.107980 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 809/1644] 10.222.0.43 () {58 vars in 957 bytes} [Sun Jul 24 01:13:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:30.669081 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd86d1-e444-41a5-9354-aae4256d29f0 service nova] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:30.710295 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd86d1-e444-41a5-9354-aae4256d29f0 service nova] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:30.714676 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e53105-ae7c-4859-8a8f-dd77de6be701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:30.715334 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e53105-ae7c-4859-8a8f-dd77de6be701 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:30.715618 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e53105-ae7c-4859-8a8f-dd77de6be701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:30.715886 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e53105-ae7c-4859-8a8f-dd77de6be701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:30.724466 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e53105-ae7c-4859-8a8f-dd77de6be701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:30.725971 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e53105-ae7c-4859-8a8f-dd77de6be701 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:30.734287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 836/1645] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:32.660090 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16939cf1-31e0-4261-871d-d93082221967 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:32.693884 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16939cf1-31e0-4261-871d-d93082221967 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:32.699026 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafaeab-57fb-4ac5-bc18-f18c87f1a829 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce671a84420484580cfd8efe6a6e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:32.699605 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafaeab-57fb-4ac5-bc18-f18c87f1a829 service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:32.699884 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafaeab-57fb-4ac5-bc18-f18c87f1a829 service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:32.700127 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafaeab-57fb-4ac5-bc18-f18c87f1a829 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:32.702096 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-aeafaeab-57fb-4ac5-bc18-f18c87f1a829 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:32.726666 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafaeab-57fb-4ac5-bc18-f18c87f1a829 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:32.728247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafaeab-57fb-4ac5-bc18-f18c87f1a829 service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:32.737967 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 810/1646] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:40.730890 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=18 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:42.733844 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=33 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:49.675527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e53105-ae7c-4859-8a8f-dd77de6be701 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:49.677172 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-49e53105-ae7c-4859-8a8f-dd77de6be701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:49.702567 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e53105-ae7c-4859-8a8f-dd77de6be701 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:49.706918 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f52f55-6a5e-4ba8-a7c6-1e4571480d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:49.707574 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f52f55-6a5e-4ba8-a7c6-1e4571480d64 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:49.707861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f52f55-6a5e-4ba8-a7c6-1e4571480d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:49.708144 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f52f55-6a5e-4ba8-a7c6-1e4571480d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:49.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f52f55-6a5e-4ba8-a7c6-1e4571480d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:49.719287 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f52f55-6a5e-4ba8-a7c6-1e4571480d64 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:49.729772 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 837/1647] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:51.442327 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a407c-9bc8-4489-a385-221ead99a069 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:51.443068 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a407c-9bc8-4489-a385-221ead99a069 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:51.443068 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a407c-9bc8-4489-a385-221ead99a069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:51.473751 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-671a407c-9bc8-4489-a385-221ead99a069 None None] MFA Rules not processed for user `8a465bdbfe3248679adc15154a152d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:51.475013 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-671a407c-9bc8-4489-a385-221ead99a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:51.489968 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 811/1648] 10.222.0.43 () {58 vars in 967 bytes} [Sun Jul 24 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:51.538106 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f52f55-6a5e-4ba8-a7c6-1e4571480d64 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:51.551489 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f52f55-6a5e-4ba8-a7c6-1e4571480d64 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:51.557406 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f298133-41a8-45ba-a557-eb3838645dc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd9e9ad3ecec40b9a3c88a5f2b8fdfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:51.558067 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f298133-41a8-45ba-a557-eb3838645dc7 service swift] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:51.558411 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f298133-41a8-45ba-a557-eb3838645dc7 service swift] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:51.558669 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f298133-41a8-45ba-a557-eb3838645dc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:51.568368 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f298133-41a8-45ba-a557-eb3838645dc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:51.570902 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f298133-41a8-45ba-a557-eb3838645dc7 service swift] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:51.581495 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 838/1649] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Jul 24 01:13:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:51.977649 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a407c-9bc8-4489-a385-221ead99a069 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:51.987396 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a407c-9bc8-4489-a385-221ead99a069 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:51.991796 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058c216-30d9-4d3e-ab66-12f076027239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:51.992780 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058c216-30d9-4d3e-ab66-12f076027239 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:51.993332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058c216-30d9-4d3e-ab66-12f076027239 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:51.993659 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058c216-30d9-4d3e-ab66-12f076027239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:52.076796 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058c216-30d9-4d3e-ab66-12f076027239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:52.078745 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058c216-30d9-4d3e-ab66-12f076027239 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:52.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 812/1650] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:55.397344 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6a225-0e56-4497-a116-95622c11e476 None None] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:55.397933 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6a225-0e56-4497-a116-95622c11e476 None None] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:55.397933 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6a225-0e56-4497-a116-95622c11e476 None None] PATH_INFO: `/` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:55.399333 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 839/1651] 10.222.0.43 () {54 vars in 921 bytes} [Sun Jul 24 01:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:13:55.431431 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e176069-ffa9-4a53-aa45-c710bdade154 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:55.431918 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e176069-ffa9-4a53-aa45-c710bdade154 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:55.432008 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e176069-ffa9-4a53-aa45-c710bdade154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:55.488022 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5e176069-ffa9-4a53-aa45-c710bdade154 None None] MFA Rules not processed for user `cce671a84420484580cfd8efe6a6e227`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:55.490772 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5e176069-ffa9-4a53-aa45-c710bdade154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:55.498010 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 813/1652] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Jul 24 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:55.509645 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6a225-0e56-4497-a116-95622c11e476 None None] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:55.523342 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6a225-0e56-4497-a116-95622c11e476 None None] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:55.528269 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d1110-4051-45c0-aa9e-72a8fca67e0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce671a84420484580cfd8efe6a6e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:55.528916 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d1110-4051-45c0-aa9e-72a8fca67e0e service placement] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:55.529196 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d1110-4051-45c0-aa9e-72a8fca67e0e service placement] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:55.529495 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d1110-4051-45c0-aa9e-72a8fca67e0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:55.540681 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d1110-4051-45c0-aa9e-72a8fca67e0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:55.542312 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d1110-4051-45c0-aa9e-72a8fca67e0e service placement] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:55.552753 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 840/1653] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:58.588217 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e176069-ffa9-4a53-aa45-c710bdade154 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:58.599263 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e176069-ffa9-4a53-aa45-c710bdade154 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:58.603960 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:58.604866 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:58.605143 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:58.605555 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] PATH_INFO: `/v3/users/8f892a8269184083b896a720ea87de05` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:58.606777 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f892a8269184083b896a720ea87de05)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:58.608754 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:58.674387 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f892a8269184083b896a720ea87de05'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:58.683109 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f892a8269184083b896a720ea87de05'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:58.690725 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f892a8269184083b896a720ea87de05'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:58.691384 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f892a8269184083b896a720ea87de05'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:58.692025 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f892a8269184083b896a720ea87de05'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:58.704692 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:58.710190 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 814/1654] 10.222.0.43 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:58 2022] DELETE /identity/v3/users/8f892a8269184083b896a720ea87de05 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:58.899666 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d1110-4051-45c0-aa9e-72a8fca67e0e service placement] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:58.914982 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d1110-4051-45c0-aa9e-72a8fca67e0e service placement] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:58.980987 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:58.981917 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:58.982204 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:58.982485 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] PATH_INFO: `/v3/projects/bb9b9924c22449a4b04ea0c0e302b701` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:58.983666 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9b9924c22449a4b04ea0c0e302b701)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:58.985637 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:59.032986 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9b9924c22449a4b04ea0c0e302b701', 'request_id': 'req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.039123 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9b9924c22449a4b04ea0c0e302b701', 'request_id': 'req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.044769 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9b9924c22449a4b04ea0c0e302b701', 'request_id': 'req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.079063 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] The token cache is being invalidate because project bb9b9924c22449a4b04ea0c0e302b701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:59.079352 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.080432 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.082123 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 841/1655] 10.222.0.43 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:58 2022] DELETE /identity/v3/projects/bb9b9924c22449a4b04ea0c0e302b701 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:59.086598 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:59.087998 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:59.102164 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b686d-6276-422b-8e38-9a534ffb3455 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:59.159364 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:59.160247 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:59.160729 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:59.160866 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] PATH_INFO: `/v3/users/e35df92a9bee40908b24d684612de3ca` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:59.164454 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35df92a9bee40908b24d684612de3ca)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:59.167375 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:59.231433 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35df92a9bee40908b24d684612de3ca'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.240422 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35df92a9bee40908b24d684612de3ca'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.250680 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35df92a9bee40908b24d684612de3ca'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.251673 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35df92a9bee40908b24d684612de3ca'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.252739 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35df92a9bee40908b24d684612de3ca'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.277251 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 815/1656] 10.222.0.43 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:59 2022] DELETE /identity/v3/users/e35df92a9bee40908b24d684612de3ca => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:59.475286 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:59.476901 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:59.490239 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393838b-5a1b-4619-b7b6-f8c9a8223a9c admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:59.523020 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:59.559519 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:59.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:59.560833 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:59.561154 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] PATH_INFO: `/v3/projects/f3a1a0024e0441c99bfbba3067e367a8` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:59.563042 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a1a0024e0441c99bfbba3067e367a8)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:59.565137 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:59.618858 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a1a0024e0441c99bfbba3067e367a8', 'request_id': 'req-ef37eca0-0e0f-4248-b346-063a3054dd01'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.625377 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a1a0024e0441c99bfbba3067e367a8', 'request_id': 'req-ef37eca0-0e0f-4248-b346-063a3054dd01'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.631611 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a1a0024e0441c99bfbba3067e367a8', 'request_id': 'req-ef37eca0-0e0f-4248-b346-063a3054dd01'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.645999 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] The token cache is being invalidate because project f3a1a0024e0441c99bfbba3067e367a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:59.646219 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.646867 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:59.648532 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 842/1657] 10.222.0.43 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:59 2022] DELETE /identity/v3/projects/f3a1a0024e0441c99bfbba3067e367a8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:09.272384 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:09.642936 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:41.142280 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:41.144914 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:41.266531 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05afa5-175a-43d5-8105-aaacfcf3a517 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:41.319404 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:41.321099 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:41.352270 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754de4e1-eb5b-47d1-905c-32b34131a38a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '808b08d1d2df42e587279071a5dba593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:41.353690 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754de4e1-eb5b-47d1-905c-32b34131a38a service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:41.354306 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754de4e1-eb5b-47d1-905c-32b34131a38a service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:41.354883 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754de4e1-eb5b-47d1-905c-32b34131a38a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:41.357577 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-754de4e1-eb5b-47d1-905c-32b34131a38a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:41.370674 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754de4e1-eb5b-47d1-905c-32b34131a38a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:41.372323 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754de4e1-eb5b-47d1-905c-32b34131a38a service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:41.383406 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37eca0-0e0f-4248-b346-063a3054dd01 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:41.384009 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 816/1658] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:41.389421 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f9680-7069-4f5f-99ef-eee59ab41751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:41.390096 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f9680-7069-4f5f-99ef-eee59ab41751 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:41.390381 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f9680-7069-4f5f-99ef-eee59ab41751 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:41.391075 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f9680-7069-4f5f-99ef-eee59ab41751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:41.392774 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5e7f9680-7069-4f5f-99ef-eee59ab41751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:41.408271 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f9680-7069-4f5f-99ef-eee59ab41751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:41.410140 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f9680-7069-4f5f-99ef-eee59ab41751 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:41.422453 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 843/1659] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:42.603922 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754de4e1-eb5b-47d1-905c-32b34131a38a service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:42.614095 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754de4e1-eb5b-47d1-905c-32b34131a38a service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:42.618574 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ea14b-1dea-4dc2-b9fb-72b18cb39c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:42.619224 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ea14b-1dea-4dc2-b9fb-72b18cb39c29 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:42.619502 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ea14b-1dea-4dc2-b9fb-72b18cb39c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:42.619767 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ea14b-1dea-4dc2-b9fb-72b18cb39c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:42.621658 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f44ea14b-1dea-4dc2-b9fb-72b18cb39c29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:42.635705 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ea14b-1dea-4dc2-b9fb-72b18cb39c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:42.637175 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ea14b-1dea-4dc2-b9fb-72b18cb39c29 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:42.650836 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 817/1660] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:51.417248 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=26 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:52.644861 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=77 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:54.046667 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f9680-7069-4f5f-99ef-eee59ab41751 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:54.056086 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f9680-7069-4f5f-99ef-eee59ab41751 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:54.060595 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dfe83-644b-45bd-a044-0928b7fae0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0dae91953bf4a84883723bf3639e377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:54.061273 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dfe83-644b-45bd-a044-0928b7fae0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:54.061556 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dfe83-644b-45bd-a044-0928b7fae0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:54.061826 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dfe83-644b-45bd-a044-0928b7fae0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:54.063864 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-5c4dfe83-644b-45bd-a044-0928b7fae0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:54.131858 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4dfe83-644b-45bd-a044-0928b7fae0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:54.133233 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4dfe83-644b-45bd-a044-0928b7fae0c4 service neutron] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:54.143094 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 844/1661] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:00.519728 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ea14b-1dea-4dc2-b9fb-72b18cb39c29 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:00.521262 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f44ea14b-1dea-4dc2-b9fb-72b18cb39c29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:00.536430 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ea14b-1dea-4dc2-b9fb-72b18cb39c29 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:00.540952 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:00.541876 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:00.542156 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:00.542427 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] PATH_INFO: `/v3/users/f31c423447a74d4d9411e20528726579` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:00.558980 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31c423447a74d4d9411e20528726579)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:00.561507 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:00.617733 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31c423447a74d4d9411e20528726579'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:00.626759 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31c423447a74d4d9411e20528726579'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:00.635974 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31c423447a74d4d9411e20528726579'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:00.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31c423447a74d4d9411e20528726579'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:00.637939 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31c423447a74d4d9411e20528726579'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:00.656904 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 818/1662] 10.222.0.43 () {58 vars in 1223 bytes} [Sun Jul 24 01:16:00 2022] DELETE /identity/v3/users/f31c423447a74d4d9411e20528726579 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:16:00.838005 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dfe83-644b-45bd-a044-0928b7fae0c4 service neutron] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:00.849527 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dfe83-644b-45bd-a044-0928b7fae0c4 service neutron] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:00.912822 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:00.913746 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:00.914034 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:00.914313 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] PATH_INFO: `/v3/projects/9c50636505744add842f10a8ccbc13d2` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:00.925961 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c50636505744add842f10a8ccbc13d2)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:00.928194 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:00.974076 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c50636505744add842f10a8ccbc13d2', 'request_id': 'req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:00.981134 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c50636505744add842f10a8ccbc13d2', 'request_id': 'req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:00.988653 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c50636505744add842f10a8ccbc13d2', 'request_id': 'req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.002703 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] The token cache is being invalidate because project 9c50636505744add842f10a8ccbc13d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:16:01.002996 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.003624 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.005249 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 845/1663] 10.222.0.43 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:00 2022] DELETE /identity/v3/projects/9c50636505744add842f10a8ccbc13d2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:16:01.009374 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:01.010774 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:01.024455 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982fec6-3a73-4195-a6e7-7312972c9f61 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:01.082383 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:01.083300 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:01.083584 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:01.083866 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] PATH_INFO: `/v3/users/bbde8079aa9c488a840b91b0e5fd0d90` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:01.097401 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbde8079aa9c488a840b91b0e5fd0d90)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:01.099345 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:01.148749 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbde8079aa9c488a840b91b0e5fd0d90'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.152591 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:01.158368 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbde8079aa9c488a840b91b0e5fd0d90'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.174782 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbde8079aa9c488a840b91b0e5fd0d90'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.175756 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbde8079aa9c488a840b91b0e5fd0d90'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.176596 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbde8079aa9c488a840b91b0e5fd0d90'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.197880 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 819/1664] 10.222.0.43 () {58 vars in 1223 bytes} [Sun Jul 24 01:16:01 2022] DELETE /identity/v3/users/bbde8079aa9c488a840b91b0e5fd0d90 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:16:01.380089 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] Authenticating user token {{(pid=80201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:01.381850 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.fernet_utils [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:01.399285 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f061dd-a054-40f1-ad1e-fb170bdc8dc4 admin admin] Validating token access rules against request {{(pid=80201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:01.411456 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:01.458507 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbb04324a8649df81c9f75c69605aae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81f52df030c4fd3aed308eec001fc7b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:01.459391 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:01.459675 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:01.459953 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e admin admin] PATH_INFO: `/v3/projects/938c7b3ecc1c43ad8570faedc072896d` {{(pid=80201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:01.470300 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=938c7b3ecc1c43ad8570faedc072896d)` {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:01.472216 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e admin admin] RBAC: Authorization granted {{(pid=80201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:01.518665 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938c7b3ecc1c43ad8570faedc072896d', 'request_id': 'req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.525079 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938c7b3ecc1c43ad8570faedc072896d', 'request_id': 'req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.530548 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938c7b3ecc1c43ad8570faedc072896d', 'request_id': 'req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e'} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.543593 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e admin admin] The token cache is being invalidate because project 938c7b3ecc1c43ad8570faedc072896d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:16:01.543861 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.544487 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG keystone.notifications [None req-4bad3e47-6d8d-40c2-978b-4e0e41aceb8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:01.546152 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: [pid: 80201|app: 0|req: 846/1665] 10.222.0.43 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:01 2022] DELETE /identity/v3/projects/938c7b3ecc1c43ad8570faedc072896d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:16:11.194172 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=12,keystone:DELETE=2 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:11.540736 dv-osbrick-master-4-iscsi devstack@keystone.service[80201]: DEBUG dbcounter [-] [80201] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80201) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:27.629990 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:27.632675 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:27.710306 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bad30-4f52-425b-8d80-2094c1200ba4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:27.777392 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6323410-8f6e-4040-9ebe-f0b4b6997739 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cce671a84420484580cfd8efe6a6e227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b7f081bd694cce90cca76194df476e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:27.778050 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6323410-8f6e-4040-9ebe-f0b4b6997739 service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:27.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6323410-8f6e-4040-9ebe-f0b4b6997739 service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:27.778638 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6323410-8f6e-4040-9ebe-f0b4b6997739 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:27.781976 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f6323410-8f6e-4040-9ebe-f0b4b6997739 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:27.793727 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6323410-8f6e-4040-9ebe-f0b4b6997739 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:27.795335 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6323410-8f6e-4040-9ebe-f0b4b6997739 service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:27.805055 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 820/1666] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:37.801192 dv-osbrick-master-4-iscsi devstack@keystone.service[80202]: DEBUG dbcounter [-] [80202] Writing DB stats keystone:SELECT=58 {{(pid=80202) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}